https://wiki.mozilla.org/api.php?action=feedcontributions&user=Bogdan.maris&feedformat=atom
MozillaWiki - User contributions [en]
2024-03-28T20:45:02Z
User contributions
MediaWiki 1.27.4
https://wiki.mozilla.org/index.php?title=Releases/Firefox_75/Test_Plan&diff=1224893
Releases/Firefox 75/Test Plan
2020-03-10T07:10:43Z
<p>Bogdan.maris: /* Beta 75 milestones */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 75 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce], [https://phonebook.mozilla.org/tree.php?search/mboldan@mozilla.com Mihai Boldan]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 75 are available [https://docs.google.com/spreadsheets/u/1/d/1Fk_wX77bV4-qifwVkRDbQpFc8TYgG8LdvrIJB8X3jl8/edit?usp=drive_web&ouid=102568952189939481948 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 75 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mnotstarted|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 75 milestones ==<br />
* '''Trello card''': https://trello.com/b/pPgjBNNd</div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_75/Test_Plan&diff=1224892
Releases/Firefox 75/Test Plan
2020-03-10T07:09:47Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 75 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce], [https://phonebook.mozilla.org/tree.php?search/mboldan@mozilla.com Mihai Boldan]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 75 are available [https://docs.google.com/spreadsheets/u/1/d/1Fk_wX77bV4-qifwVkRDbQpFc8TYgG8LdvrIJB8X3jl8/edit?usp=drive_web&ouid=102568952189939481948 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 75 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mnotstarted|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 75 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 75.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/tbd tbd], buildID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/tbd TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
* '''Trello card''': https://trello.com/b/pPgjBNNd<br />
<br />
=== RC build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">75.0-build1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/tbd tbd], buildID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''areas''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/tbd TestRail]<br />
*** {{mnotstarted|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted}} beta → [https://docs.google.com/spreadsheets/u/1/d/1vQGMd6fmlyt_7ItMhHKtyUwQ1Wr88ns9miKHTIqWonM/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release-localtest → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release-cdntest → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_75/Test_Plan&diff=1224891
Releases/Firefox 75/Test Plan
2020-03-10T07:08:15Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 75 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce], [https://phonebook.mozilla.org/tree.php?search/mboldan@mozilla.com Mihai Boldan]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 75 are available [https://docs.google.com/spreadsheets/u/1/d/1Fk_wX77bV4-qifwVkRDbQpFc8TYgG8LdvrIJB8X3jl8/edit?usp=drive_web&ouid=102568952189939481948 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 75 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mnotstarted|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 75 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 75.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/tbd tbd], buildID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/tbd TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">75.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Trello card''': https://trello.com/b/pPgjBNNd<br />
</div></div><br />
<br />
=== RC build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">75.0-build1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/tbd tbd], buildID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''areas''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/tbd TestRail]<br />
*** {{mnotstarted|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted}} beta → [https://docs.google.com/spreadsheets/u/1/d/1vQGMd6fmlyt_7ItMhHKtyUwQ1Wr88ns9miKHTIqWonM/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release-localtest → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release-cdntest → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_75/Test_Plan&diff=1224890
Releases/Firefox 75/Test Plan
2020-03-10T07:04:59Z
<p>Bogdan.maris: </p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 75 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce], [https://phonebook.mozilla.org/tree.php?search/mboldan@mozilla.com Mihai Boldan]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 75 are available [https://docs.google.com/spreadsheets/u/1/d/1Fk_wX77bV4-qifwVkRDbQpFc8TYgG8LdvrIJB8X3jl8/edit?usp=drive_web&ouid=102568952189939481948 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 75 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mnotstarted|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 75 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 75.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/tbd tbd], buildID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/tbd TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">75.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2a94604e87b36c6edaffd365fe5bb0aa1da3ef5b 2a94604e87b3], 20200210140608) - <font style="color:green; font-weight:bold;">Done</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mnotstarted|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== RC build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">75.0-build1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/tbd tbd], buildID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''areas''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/tbd TestRail]<br />
*** {{mnotstarted|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted}} beta → [https://docs.google.com/spreadsheets/u/1/d/1vQGMd6fmlyt_7ItMhHKtyUwQ1Wr88ns9miKHTIqWonM/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release-localtest → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release-cdntest → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_75/Test_Plan&diff=1224888
Releases/Firefox 75/Test Plan
2020-03-10T07:00:49Z
<p>Bogdan.maris: Created page with "= Summary = The purpose of this page is to track the testing of Firefox 75 from Nightly to Release, and post Release if needed. == Release schedule == * [https://calendar.goo..."</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 75 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce], [https://phonebook.mozilla.org/tree.php?search/mboldan@mozilla.com Mihai Boldan]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 75 are available [https://docs.google.com/spreadsheets/u/1/d/1Fk_wX77bV4-qifwVkRDbQpFc8TYgG8LdvrIJB8X3jl8/edit?usp=drive_web&ouid=102568952189939481948 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 75 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mnotstarted|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 75.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 74 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 75.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/tbd tbd], buildID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/tbd TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">75.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2a94604e87b36c6edaffd365fe5bb0aa1da3ef5b 2a94604e87b3], 20200210140608) - <font style="color:green; font-weight:bold;">Done</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mnotstarted|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== RC build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">75.0-build1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 75.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/tbd tbd], buildID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''areas''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/tbd TestRail]<br />
*** {{mnotstarted|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted}} beta → [https://docs.google.com/spreadsheets/u/1/d/1vQGMd6fmlyt_7ItMhHKtyUwQ1Wr88ns9miKHTIqWonM/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release-localtest → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release-cdntest → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
*** {{mnotstarted}} release → [https://docs.google.com/spreadsheets/d/14AUQjrtuNxsRS0yNEIxj3nNHY4PzBWDuqH9I1X8rVAs/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1223975
Releases/Firefox 73/Test Plan
2020-02-19T16:05:43Z
<p>Bogdan.maris: /* Release 73 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24225 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e592eb8fc8c2b5a7fd971c1430c70de8f058a071 e592eb8fc8c2b5a7fd971c1430c70de8f058a071], 20200110003145) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Geolocation''', '''Form Autofill''', '''Password Manager 2.0''', '''Preferences ''', '''Notifications, Push Notifications and Alerts''', '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24268 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1tl2K8XD9gwrMASHwIJ6dcmkV4bEZQD1mVhHm2U0Yn9Y/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/599d3e91827c8c124e9345fb88ba42b7a238b75d 599d3e91827c8c124e9345fb88ba42b7a238b75d], 20200112220634) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Downloads''', '''Security and Privacy''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24315 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1qJA1xAWNH6qsEZevnQ3QkUxmSD-No3ojNoQu8APyIac/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Address Bar and Search''', '''Security and Privacy''' and '''Scrolling, Panning and Zooming''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1cEJN-xbbanskopWUOx9mjU8-lJO_gJ0gcdiVIHk_-Xk/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/21980c8b11cca172f8d69f0e31ddfde00c98e02f 21980c8b11cca172f8d69f0e31ddfde00c98e02f], 20200116232741) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''', '''Notifications, Push Notifications and Alerts''', '''Session Restore''' and '''Password Manager''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1772hSxW2E3IyGuR-KBC_zcpr8ksyoMlPwSKd3itBcTI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728dbfe37351e0de812e906c436a5d4 a89261364728dbfe37351e0de812e906c436a5d4], 20190325125126) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''', '''Graphics''', '''Printing''', '''Drag and Drop''' and '''Security and Privacy''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24665 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1O-s28rVL-9u72E9pvYoEqIhDZUqXfEkJaMxFUUT0NRI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6a9e651e0831 6a9e651e0831], 20200122012721) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24793 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1q7Dh9rG4nMkeOLQnsCRIQP5DUf0J4TsjhPRhXojXmlA/edit?pli=1#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/3f19dfb367d6 3f19dfb367d6], 20200124022546) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hvwohnE53jvCXdboPqpdk69kcBGcKk12PLoy3mcHw1g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/38fc7c5ed55f 38fc7c5ed55f], 20200125104833) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Crash Reporting''', '''Security and Privacy''', '''Images''', '''PDF Viewer''', '''Password Manager''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24870 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15_dTJXC85an6EeWv1Z4Gw96OUrtSRJg0LSgGx8O3R50/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/c24dfbda267e c24dfbda267e], 20200128001646) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Password Manager''', '''Data Migration''', '''Sync & Firefox Account''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25024 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1GjEWX8pYwt5lRZDQGHzGwGr2_sjYCO2yVk77QApAFtU/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b12</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/14ac73797dd8 14ac73797dd8], 20200130174018) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Preferences''', '''Menus''', '''Reader View''', '''Find Toolbar''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25099 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/19eRl3jOlR2i3Zn4EcNRUkrNLamdLT2aVPCbD_YbmjDY/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 73 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 73.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 73.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/2b0af2646bc152c852bbe8effda16188318d6aff 2b0af2646bc152c852bbe8effda16188318d6aff], 20200203203546) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/25195 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1usdmHVC_zMHB_uMmGNtTY-ozR44-md2n3OBn-7SWAFU/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Cl2Cd05y4thFMyXoY_1LrRVXk3h3T3dcl6YuP9Gy5kA/edit report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Cl2Cd05y4thFMyXoY_1LrRVXk3h3T3dcl6YuP9Gy5kA/edit report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1Cl2Cd05y4thFMyXoY_1LrRVXk3h3T3dcl6YuP9Gy5kA/edit report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 73.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 73.0-build2 ([https://hg.mozilla.org/releases/mozilla-release/rev/870866f45468 870866f45468], 20200207001703) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/25351 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1OyseSFBf3sUWvXyxMo5gzkIgrgddaHRpoCSeVhtNskw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1OKpQz0D48JrI0s32XAURrcra5d0R8pwbR2UfNa9tODE/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1OKpQz0D48JrI0s32XAURrcra5d0R8pwbR2UfNa9tODE/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1OKpQz0D48JrI0s32XAURrcra5d0R8pwbR2UfNa9tODE/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC3 73.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 73.0-build3 ([https://hg.mozilla.org/releases/mozilla-release/rev/816e7f294781 816e7f294781], 20200207195153) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/reports/view/2440 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1OyseSFBf3sUWvXyxMo5gzkIgrgddaHRpoCSeVhtNskw/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1JAo62JKPvzu6kpeeIiyq7clOnAabCdIlNdzCIVIkkT0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1OKpQz0D48JrI0s32XAURrcra5d0R8pwbR2UfNa9tODE/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 73.0.1</div><br />
<div class="mw-collapsible-content"><br />
* Build: 73.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/5b0905233e5d29d9fbad98c1380030387cda5dd9 5b0905233e5d], 20200217142647) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/25880 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/18riwBhRp74gjeP_s_2l648xPJMSJ4TbbjZiknCKz2vg/edit#gid=850719639 report]<br />
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/d/18riwBhRp74gjeP_s_2l648xPJMSJ4TbbjZiknCKz2vg/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_74/Test_Plan&diff=1223974
Releases/Firefox 74/Test Plan
2020-02-19T16:03:34Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 74 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 74 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 74 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 74.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mnotstarted|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 74.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 74 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 74.0b1a(placeholder)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 74.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">Placeholder</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">74.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 74.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2a94604e87b36c6edaffd365fe5bb0aa1da3ef5b 2a94604e87b3], 20200210140608) - <font style="color:green; font-weight:bold;">Done</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">74.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 74.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2a94604e87b36c6edaffd365fe5bb0aa1da3ef5b 2a94604e87b3], 20200210140608) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Address Bar and Search''', '''Downloads''', '''Security and Privacy - Cryptomining ''' and '''Security and Privacy - Anti-Tracking: Anti-Fingerprinting in Standard Mode''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25594 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1ErD75dHNXsgcYFkDGjXFhaaixP8hYv-frVK1aNr8Cu0/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">74.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 74.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/64dab3403abc272111d36fb8e9f7c37d6058ea05 64dab3403abc], 20200214015126) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Windows Child Mode Functionality''', '''Protection Panel''', '''Protections Report''', '''Protections Report''', '''Zooming''', '''Geolocation''' and '''Drag and Drop''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25662 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FnQhXhi2GW43e5CfgAyfl0uAurKPVrWJyKJkS4pv8r0/edit#gid=0 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">74.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 74.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/dcc5fa49cdd314f32d969182cbfba6418b37c2d5 dcc5fa49cdd3], 20200216164042) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Playback''', '''Block All Autoplay (Fx69+)''', '''Global Default Zoom Level (Fx73+)''', '''DNS over HTTPS(Provider Selection)''', and '''Tabbed Browser''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25705 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1nnsCA-ITDWjNRQg3SouZRFdQ4erl8r4i3C3oR87FdoA/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">74.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 74.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/b07664d2bf2863ffac34a5fbbd97d64b5884576a b07664d2bf28], 20200218224219) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''', '''Theme and Toolbar Customization''', '''PDF Viewer''', '''Bookmarks and History''' and '''Password Manager (Autocomplete and Autofill)''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25917 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?ts=560bfa5b#gid=1443821005 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11lrtX016K0uROHAm29N0ugfIGOXuEWixhdsPL8ug3Hc/edit report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1223096
Releases/Firefox 73/Test Plan
2020-02-04T14:38:22Z
<p>Bogdan.maris: /* Release 73 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24225 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e592eb8fc8c2b5a7fd971c1430c70de8f058a071 e592eb8fc8c2b5a7fd971c1430c70de8f058a071], 20200110003145) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Geolocation''', '''Form Autofill''', '''Password Manager 2.0''', '''Preferences ''', '''Notifications, Push Notifications and Alerts''', '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24268 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1tl2K8XD9gwrMASHwIJ6dcmkV4bEZQD1mVhHm2U0Yn9Y/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/599d3e91827c8c124e9345fb88ba42b7a238b75d 599d3e91827c8c124e9345fb88ba42b7a238b75d], 20200112220634) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Downloads''', '''Security and Privacy''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24315 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1qJA1xAWNH6qsEZevnQ3QkUxmSD-No3ojNoQu8APyIac/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Address Bar and Search''', '''Security and Privacy''' and '''Scrolling, Panning and Zooming''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1cEJN-xbbanskopWUOx9mjU8-lJO_gJ0gcdiVIHk_-Xk/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/21980c8b11cca172f8d69f0e31ddfde00c98e02f 21980c8b11cca172f8d69f0e31ddfde00c98e02f], 20200116232741) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''', '''Notifications, Push Notifications and Alerts''', '''Session Restore''' and '''Password Manager''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1772hSxW2E3IyGuR-KBC_zcpr8ksyoMlPwSKd3itBcTI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728dbfe37351e0de812e906c436a5d4 a89261364728dbfe37351e0de812e906c436a5d4], 20190325125126) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''', '''Graphics''', '''Printing''', '''Drag and Drop''' and '''Security and Privacy''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24665 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1O-s28rVL-9u72E9pvYoEqIhDZUqXfEkJaMxFUUT0NRI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6a9e651e0831 6a9e651e0831], 20200122012721) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24793 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1q7Dh9rG4nMkeOLQnsCRIQP5DUf0J4TsjhPRhXojXmlA/edit?pli=1#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/3f19dfb367d6 3f19dfb367d6], 20200124022546) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hvwohnE53jvCXdboPqpdk69kcBGcKk12PLoy3mcHw1g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/38fc7c5ed55f 38fc7c5ed55f], 20200125104833) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Crash Reporting''', '''Security and Privacy''', '''Images''', '''PDF Viewer''', '''Password Manager''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24870 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15_dTJXC85an6EeWv1Z4Gw96OUrtSRJg0LSgGx8O3R50/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/c24dfbda267e c24dfbda267e], 20200128001646) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Password Manager''', '''Data Migration''', '''Sync & Firefox Account''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25024 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1GjEWX8pYwt5lRZDQGHzGwGr2_sjYCO2yVk77QApAFtU/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b12</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/14ac73797dd8 14ac73797dd8], 20200130174018) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Preferences''', '''Menus''', '''Reader View''', '''Find Toolbar''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25099 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/19eRl3jOlR2i3Zn4EcNRUkrNLamdLT2aVPCbD_YbmjDY/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 73 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 73.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 73.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/2b0af2646bc152c852bbe8effda16188318d6aff 2b0af2646bc152c852bbe8effda16188318d6aff], 20200203203546) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{inprogress|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/25195 TestRail]<br />
*** {{inprogress|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1usdmHVC_zMHB_uMmGNtTY-ozR44-md2n3OBn-7SWAFU/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Cl2Cd05y4thFMyXoY_1LrRVXk3h3T3dcl6YuP9Gy5kA/edit report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Cl2Cd05y4thFMyXoY_1LrRVXk3h3T3dcl6YuP9Gy5kA/edit report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1Cl2Cd05y4thFMyXoY_1LrRVXk3h3T3dcl6YuP9Gy5kA/edit report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1223008
Releases/Firefox 73/Test Plan
2020-01-31T15:09:07Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24225 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e592eb8fc8c2b5a7fd971c1430c70de8f058a071 e592eb8fc8c2b5a7fd971c1430c70de8f058a071], 20200110003145) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Geolocation''', '''Form Autofill''', '''Password Manager 2.0''', '''Preferences ''', '''Notifications, Push Notifications and Alerts''', '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24268 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1tl2K8XD9gwrMASHwIJ6dcmkV4bEZQD1mVhHm2U0Yn9Y/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/599d3e91827c8c124e9345fb88ba42b7a238b75d 599d3e91827c8c124e9345fb88ba42b7a238b75d], 20200112220634) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Downloads''', '''Security and Privacy''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24315 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1qJA1xAWNH6qsEZevnQ3QkUxmSD-No3ojNoQu8APyIac/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Address Bar and Search''', '''Security and Privacy''' and '''Scrolling, Panning and Zooming''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1cEJN-xbbanskopWUOx9mjU8-lJO_gJ0gcdiVIHk_-Xk/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/21980c8b11cca172f8d69f0e31ddfde00c98e02f 21980c8b11cca172f8d69f0e31ddfde00c98e02f], 20200116232741) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''', '''Notifications, Push Notifications and Alerts''', '''Session Restore''' and '''Password Manager''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1772hSxW2E3IyGuR-KBC_zcpr8ksyoMlPwSKd3itBcTI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728dbfe37351e0de812e906c436a5d4 a89261364728dbfe37351e0de812e906c436a5d4], 20190325125126) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''', '''Graphics''', '''Printing''', '''Drag and Drop''' and '''Security and Privacy''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24665 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1O-s28rVL-9u72E9pvYoEqIhDZUqXfEkJaMxFUUT0NRI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6a9e651e0831 6a9e651e0831], 20200122012721) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24793 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1q7Dh9rG4nMkeOLQnsCRIQP5DUf0J4TsjhPRhXojXmlA/edit?pli=1#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/3f19dfb367d6 3f19dfb367d6], 20200124022546) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hvwohnE53jvCXdboPqpdk69kcBGcKk12PLoy3mcHw1g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/38fc7c5ed55f 38fc7c5ed55f], 20200125104833) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Crash Reporting''', '''Security and Privacy''', '''Images''', '''PDF Viewer''', '''Password Manager''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24870 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15_dTJXC85an6EeWv1Z4Gw96OUrtSRJg0LSgGx8O3R50/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/c24dfbda267e c24dfbda267e], 20200128001646) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Password Manager''', '''Data Migration''', '''Sync & Firefox Account''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25024 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1GjEWX8pYwt5lRZDQGHzGwGr2_sjYCO2yVk77QApAFtU/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b12</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/14ac73797dd8 14ac73797dd8], 20200130174018) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Preferences''', '''Menus''', '''Reader View''', '''Find Toolbar''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25099 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/19eRl3jOlR2i3Zn4EcNRUkrNLamdLT2aVPCbD_YbmjDY/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1223007
Releases/Firefox 73/Test Plan
2020-01-31T15:08:45Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24225 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e592eb8fc8c2b5a7fd971c1430c70de8f058a071 e592eb8fc8c2b5a7fd971c1430c70de8f058a071], 20200110003145) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Geolocation''', '''Form Autofill''', '''Password Manager 2.0''', '''Preferences ''', '''Notifications, Push Notifications and Alerts''', '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24268 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1tl2K8XD9gwrMASHwIJ6dcmkV4bEZQD1mVhHm2U0Yn9Y/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/599d3e91827c8c124e9345fb88ba42b7a238b75d 599d3e91827c8c124e9345fb88ba42b7a238b75d], 20200112220634) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Downloads''', '''Security and Privacy''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24315 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1qJA1xAWNH6qsEZevnQ3QkUxmSD-No3ojNoQu8APyIac/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Address Bar and Search''', '''Security and Privacy''' and '''Scrolling, Panning and Zooming''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1cEJN-xbbanskopWUOx9mjU8-lJO_gJ0gcdiVIHk_-Xk/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/21980c8b11cca172f8d69f0e31ddfde00c98e02f 21980c8b11cca172f8d69f0e31ddfde00c98e02f], 20200116232741) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''', '''Notifications, Push Notifications and Alerts''', '''Session Restore''' and '''Password Manager''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1772hSxW2E3IyGuR-KBC_zcpr8ksyoMlPwSKd3itBcTI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728dbfe37351e0de812e906c436a5d4 a89261364728dbfe37351e0de812e906c436a5d4], 20190325125126) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''', '''Graphics''', '''Printing''', '''Drag and Drop''' and '''Security and Privacy''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24665 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1O-s28rVL-9u72E9pvYoEqIhDZUqXfEkJaMxFUUT0NRI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6a9e651e0831 6a9e651e0831], 20200122012721) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24793 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1q7Dh9rG4nMkeOLQnsCRIQP5DUf0J4TsjhPRhXojXmlA/edit?pli=1#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/3f19dfb367d6 3f19dfb367d6], 20200124022546) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hvwohnE53jvCXdboPqpdk69kcBGcKk12PLoy3mcHw1g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/38fc7c5ed55f 38fc7c5ed55f], 20200125104833) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Crash Reporting''', '''Security and Privacy''', '''Images''', '''PDF Viewer''', '''Password Manager''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24870 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15_dTJXC85an6EeWv1Z4Gw96OUrtSRJg0LSgGx8O3R50/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/c24dfbda267e c24dfbda267e], 20200128001646) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Password Manager''', '''Data Migration''', '''Sync & Firefox Account''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25024 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1GjEWX8pYwt5lRZDQGHzGwGr2_sjYCO2yVk77QApAFtU/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b12</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/14ac73797dd8 14ac73797dd8], 20200130174018) - <font style="color:blue; font-weight:bold;">IN PROGRESS</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Preferences''', '''Menus''', '''Reader View''', '''Find Toolbar''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25099 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/19eRl3jOlR2i3Zn4EcNRUkrNLamdLT2aVPCbD_YbmjDY/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1222999
Releases/Firefox 73/Test Plan
2020-01-31T10:18:07Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24225 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e592eb8fc8c2b5a7fd971c1430c70de8f058a071 e592eb8fc8c2b5a7fd971c1430c70de8f058a071], 20200110003145) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Geolocation''', '''Form Autofill''', '''Password Manager 2.0''', '''Preferences ''', '''Notifications, Push Notifications and Alerts''', '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24268 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1tl2K8XD9gwrMASHwIJ6dcmkV4bEZQD1mVhHm2U0Yn9Y/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/599d3e91827c8c124e9345fb88ba42b7a238b75d 599d3e91827c8c124e9345fb88ba42b7a238b75d], 20200112220634) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Downloads''', '''Security and Privacy''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24315 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1qJA1xAWNH6qsEZevnQ3QkUxmSD-No3ojNoQu8APyIac/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Address Bar and Search''', '''Security and Privacy''' and '''Scrolling, Panning and Zooming''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1cEJN-xbbanskopWUOx9mjU8-lJO_gJ0gcdiVIHk_-Xk/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/21980c8b11cca172f8d69f0e31ddfde00c98e02f 21980c8b11cca172f8d69f0e31ddfde00c98e02f], 20200116232741) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''', '''Notifications, Push Notifications and Alerts''', '''Session Restore''' and '''Password Manager''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1772hSxW2E3IyGuR-KBC_zcpr8ksyoMlPwSKd3itBcTI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728dbfe37351e0de812e906c436a5d4 a89261364728dbfe37351e0de812e906c436a5d4], 20190325125126) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''', '''Graphics''', '''Printing''', '''Drag and Drop''' and '''Security and Privacy''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24665 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1O-s28rVL-9u72E9pvYoEqIhDZUqXfEkJaMxFUUT0NRI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6a9e651e0831 6a9e651e0831], 20200122012721) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24793 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1q7Dh9rG4nMkeOLQnsCRIQP5DUf0J4TsjhPRhXojXmlA/edit?pli=1#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/3f19dfb367d6 3f19dfb367d6], 20200124022546) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hvwohnE53jvCXdboPqpdk69kcBGcKk12PLoy3mcHw1g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/38fc7c5ed55f 38fc7c5ed55f], 20200125104833) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Crash Reporting''', '''Security and Privacy''', '''Images''', '''PDF Viewer''', '''Password Manager''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24870 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15_dTJXC85an6EeWv1Z4Gw96OUrtSRJg0LSgGx8O3R50/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/c24dfbda267e c24dfbda267e], 20200128001646) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Password Manager''', '''Data Migration''', '''Sync & Firefox Account''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25024 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1GjEWX8pYwt5lRZDQGHzGwGr2_sjYCO2yVk77QApAFtU/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b12</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/14ac73797dd8 14ac73797dd8], 20200130174018) - <font style="color:blue; font-weight:bold;">IN PROGRESS</font><br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Smoke, Regression and Exploratory testing on '''Preferences''', '''Menus''', '''Reader View''', '''Find Toolbar''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25099 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/19eRl3jOlR2i3Zn4EcNRUkrNLamdLT2aVPCbD_YbmjDY/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1222996
Releases/Firefox 73/Test Plan
2020-01-31T07:16:32Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24225 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e592eb8fc8c2b5a7fd971c1430c70de8f058a071 e592eb8fc8c2b5a7fd971c1430c70de8f058a071], 20200110003145) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Geolocation''', '''Form Autofill''', '''Password Manager 2.0''', '''Preferences ''', '''Notifications, Push Notifications and Alerts''', '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24268 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1tl2K8XD9gwrMASHwIJ6dcmkV4bEZQD1mVhHm2U0Yn9Y/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/599d3e91827c8c124e9345fb88ba42b7a238b75d 599d3e91827c8c124e9345fb88ba42b7a238b75d], 20200112220634) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Downloads''', '''Security and Privacy''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24315 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1qJA1xAWNH6qsEZevnQ3QkUxmSD-No3ojNoQu8APyIac/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Address Bar and Search''', '''Security and Privacy''' and '''Scrolling, Panning and Zooming''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1cEJN-xbbanskopWUOx9mjU8-lJO_gJ0gcdiVIHk_-Xk/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/21980c8b11cca172f8d69f0e31ddfde00c98e02f 21980c8b11cca172f8d69f0e31ddfde00c98e02f], 20200116232741) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''', '''Notifications, Push Notifications and Alerts''', '''Session Restore''' and '''Password Manager''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1772hSxW2E3IyGuR-KBC_zcpr8ksyoMlPwSKd3itBcTI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728dbfe37351e0de812e906c436a5d4 a89261364728dbfe37351e0de812e906c436a5d4], 20190325125126) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''', '''Graphics''', '''Printing''', '''Drag and Drop''' and '''Security and Privacy''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24665 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1O-s28rVL-9u72E9pvYoEqIhDZUqXfEkJaMxFUUT0NRI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6a9e651e0831 6a9e651e0831], 20200122012721) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24793 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1q7Dh9rG4nMkeOLQnsCRIQP5DUf0J4TsjhPRhXojXmlA/edit?pli=1#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/3f19dfb367d6 3f19dfb367d6], 20200124022546) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hvwohnE53jvCXdboPqpdk69kcBGcKk12PLoy3mcHw1g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/38fc7c5ed55f 38fc7c5ed55f], 20200125104833) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Crash Reporting''', '''Security and Privacy''', '''Images''', '''PDF Viewer''', '''Password Manager''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24870 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15_dTJXC85an6EeWv1Z4Gw96OUrtSRJg0LSgGx8O3R50/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/c24dfbda267e c24dfbda267e], 20200128001646) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Password Manager''', '''Data Migration''', '''Sync & Firefox Account''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25024 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1GjEWX8pYwt5lRZDQGHzGwGr2_sjYCO2yVk77QApAFtU/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b12</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/14ac73797dd8 14ac73797dd8], 20200130174018) - <font style="color:blue; font-weight:bold;">IN PROGRESS</font><br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Smoke, Regression and Exploratory testing on '''Preferences''', '''Menus''', '''Reader View''', '''Find Toolbar''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/25099 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1GjEWX8pYwt5lRZDQGHzGwGr2_sjYCO2yVk77QApAFtU/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1222724
Releases/Firefox 73/Test Plan
2020-01-22T08:17:24Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' , '''Build Branding''' , '''WebExtensions''' , '''Theme and Toolbar Customization''' , '''Web Compatibility''', '''Sync & Firefox Account''', '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24225 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e592eb8fc8c2b5a7fd971c1430c70de8f058a071 e592eb8fc8c2b5a7fd971c1430c70de8f058a071], 20200110003145) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Geolocation''', '''Form Autofill''', '''Password Manager 2.0''', '''Preferences ''', '''Notifications, Push Notifications and Alerts''', '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24268 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1tl2K8XD9gwrMASHwIJ6dcmkV4bEZQD1mVhHm2U0Yn9Y/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/599d3e91827c8c124e9345fb88ba42b7a238b75d 599d3e91827c8c124e9345fb88ba42b7a238b75d], 20200112220634) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Downloads''', '''Security and Privacy''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24315 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1qJA1xAWNH6qsEZevnQ3QkUxmSD-No3ojNoQu8APyIac/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/087b0cab93cc2c55a84e3fd491160cc183e60bfd 087b0cab93cc2c55a84e3fd491160cc183e60bfd], 20200115020958) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Address Bar and Search''', '''Security and Privacy''' and '''Scrolling, Panning and Zooming''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1cEJN-xbbanskopWUOx9mjU8-lJO_gJ0gcdiVIHk_-Xk/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/21980c8b11cca172f8d69f0e31ddfde00c98e02f 21980c8b11cca172f8d69f0e31ddfde00c98e02f], 20200116232741) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''', '''Notifications, Push Notifications and Alerts''', '''Session Restore''' and '''Password Manager''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24547 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1772hSxW2E3IyGuR-KBC_zcpr8ksyoMlPwSKd3itBcTI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a89261364728dbfe37351e0de812e906c436a5d4 a89261364728dbfe37351e0de812e906c436a5d4], 20190325125126) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''', '''Graphics''', '''Printing''', '''Drag and Drop''' and '''Security and Privacy''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24665 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1O-s28rVL-9u72E9pvYoEqIhDZUqXfEkJaMxFUUT0NRI/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6a9e651e0831 6a9e651e0831], 20200122012721) - <font style="color:green; font-weight:bold;">IN PROGRESS</font><br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24793 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1O-s28rVL-9u72E9pvYoEqIhDZUqXfEkJaMxFUUT0NRI/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_68_ESR/Test_Plan&diff=1222566
Releases/Firefox 68 ESR/Test Plan
2020-01-20T15:53:42Z
<p>Bogdan.maris: /* Checklist */</p>
<hr />
<div>== Firefox 68.0 ESR ==<br />
=== Build 1 ===<br />
* 68.0.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/debdf96baee1d54d22415ca3981179264d342c47 debdf96baee1d54d22415ca3981179264d342c47]<br />
* Build ID: 20190704173630<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: navy; font-size: 80%; font-weight: bold">[ON TRACK]</font> Manual testing'''<br />
** {{done|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/18626 TestRail]<br />
** {{mnotstarted|}} Bug fix verification → [ Bugzilla]<br />
** {{mnotstarted|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[NOT APPLICABLE]</font> Update tests (manual)'''<br />
** out of scope, updates are not generated for the first ESR<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1563514, 1563707",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1277327, 1305028, 1305744, 1309534, 1393460, 1402827, 1413233, 1441128, 1441881, 1442613, 1459211, 1477796, 1480788, 1489853, 1491256, 1498112, 1515289, 1515667, 1528968, 1544422, 1551881, 1563514, 1563554, 1563707, 1563715, 1563758, 545940",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
=== Build 2 ===<br />
* 68.0esr-build2<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/501f4667334f 501f4667334f]<br />
* Build ID: 20190705221915<br />
<br />
==== Checklist ====<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Automated testing'''<br />
** {{mdone|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=501f4667334f Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/18795 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzil.la/1558299 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzil.la/1558299 Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[NOT APPLICABLE]</font> Update tests (manual)'''<br />
** out of scope, updates are not generated for the first ESR<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1309534, 1498112, 1563715",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.0.1 ESR ==<br />
=== Build 1 ===<br />
* 68.0.1esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/61219aed2735 61219aed2735]<br />
* Build ID: 20190717193731<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{done|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19062 TestRail]<br />
** {{done|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1553586%2C1556846%2C1558503%2C1565779%2C1566206&list_id=14810958 Bugzilla]<br />
** {{done|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1E5xv2xxUYrmZqXsbzfIOlASdsRlvnCrcHTlCBAK8yV8/edit#gid=850719639 report]<br />
** {{mnotstarted|}} esr → [https://docs.google.com/spreadsheets/d/1E5xv2xxUYrmZqXsbzfIOlASdsRlvnCrcHTlCBAK8yV8/edit#gid=850719639 report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":",",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1222711, 1309534, 1393460, 1402827, 1458470, 1458471, 1462334, 1498112, 1515289",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.0.2 ESR ==<br />
=== Build 1 ===<br />
* 68.0.2esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/f1258d45d4b5 f1258d45d4b5]<br />
* Build ID: 20190813155538<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19587 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1560228%2C%201565542%2C%201567614%2C%201569244&list_id=14850527 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[ON TRACK]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1M2qrcXQkn8w5TeHZLbFQow0Rgy4ltXZvSbgxKwbSdAA/edit?usp=sharing report]<br />
** {{mnotstarted|}} esr → [https://docs.google.com/spreadsheets/d/1M2qrcXQkn8w5TeHZLbFQow0Rgy4ltXZvSbgxKwbSdAA/edit?usp=sharing report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":",",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214,1393460,1528958,1563758,1566795,1566825",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.1 ESR ==<br />
=== Build 1 ===<br />
* 68.1.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/380fedbb18002297f1b233bd9c09764e59ddaa86 380fedbb18002297f1b233bd9c09764e59ddaa86]<br />
* Build ID: 20190826132627<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19983 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1428917%201538995%201558924%201563617%201568108%201568855&list_id=14867552 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-localtest → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
** {{mdone|}} esr → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"TBD",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"508606, 558178, 839074, 1037792, 1089326, 1144124, 1194214, 1195053, 1210769, 1230678, 1282075, 1300525, 1305744, 1309534, 1370743, 1393460, 1427280, 1430114, 1436015, 1458470, 1458471, 1470154, 1510235, 1521769, 1525243, 1529882, 1535539, 1541345, 1541376, 1563709, 1563715, 1563758, 1566795, 1572857",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.2 ESR ==<br />
=== Build 1 ===<br />
* 68.2.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/ce462a42d4f7aa92e526fab29baea17ab5985841 ce462a42d4f7aa92e526fab29baea17ab5985841]<br />
* Build ID: 20191016163237<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/21588 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1428917%201538995%201558924%201563617%201568108%201568855&list_id=14867552 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1581117%201574963%201565318%201563295%201585367%201580737%201577149%201575681%201575273%201574944%201573967%201572793%201583660%201578341%201566180%201564639&list_id=14947819 Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-localtest → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
** {{mdone|}} esr-cdntest → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
** {{mdone|}} esr → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"839074, 1037792, 1043280, 1144124, 1194214, 1195053, 1210769, 1282075, 1309534, 1360545, 1370743, 1393460, 1427280, 1443511, 1470154, 1470409, 1525243, 1535539, 1541345, 1541376, 1543386, 1550472, 1555695, 1563715, 1563758, 1564092, 1582378, 1587014",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.3 ESR ==<br />
=== Build 2 ===<br />
* 68.3.0esr-build2<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/fd17b62d5247816244c319271800ef1df2697c82 fd17b62d5247816244c319271800ef1df2697c82]<br />
* Build ID: 20191126000427<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/22795 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1560808%2C1585106%2C1591077%2C1590728%2C1560667%2C1587793%2C1595632%2C1581782%2C1572089%2C1594136%2C1426865%2C1593540%2C1575934%2C1581084%2C1588558%2C1591967%2C1573753%2C1574243%2C1593041%2C1597543%2C1592502%2C1595664%2C1592371%2C1580288%2C1589706%2C1578907%2C1583957%2C1589422%2C1578143%2C1540903%2C1530190%2C1589972%2C1500436%2C1586309%2C1590527%2C1554805%2C1579906%2C1567209%2C1596801%2C1588975%2C1584986%2C1585760%2C1218456%2C1580695%2C1597273%2C1318858%2C1589900%2C1576374%2C1577312%2C1591334%2C1586913%2C1595368%2C1596078%2C1582215%2C1499093%2C1546801%2C1564127%2C1575974%2C1543231%2C1570559%2C1546331%2C1577223%2C1586313%2C1586312%2C1586311%2C1586310%2C1590845%2C1579612%2C1590453%2C1449736%2C1587962%2C1591691%2C1593322%2C1586307%2C1586302%2C1586303%2C1595536%2C1586308%2C1322864%2C1510494%2C1533818%2C1586496%2C1579127%2C1597043%2C1587543%2C1587067%2C1584170%2C1581805%2C1580320%2C1580156&list_id=15005726 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1581117%201574963%201565318%201563295%201585367%201580737%201577149%201575681%201575273%201574944%201573967%201572793%201583660%201578341%201566180%201564639&list_id=14947819 Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mprog|}} esr-localtest → [https://docs.google.com/spreadsheets/d/1aLXxd7yMJaisaWPaW_lBTeMyOyGXiie-pRjoJrphu4E/edit#gid=850719639 report]<br />
** {{mnotstarted|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1aLXxd7yMJaisaWPaW_lBTeMyOyGXiie-pRjoJrphu4E/edit#gid=850719639 report]<br />
** {{mnotstarted|}} esr → [https://docs.google.com/spreadsheets/d/1aLXxd7yMJaisaWPaW_lBTeMyOyGXiie-pRjoJrphu4E/edit#gid=850719639 report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1599989, 1600024",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1037792, 1144124, 1188770, 1194214, 1282075, 1306270, 1360545, 1368158, 1370743, 1393460, 1427280, 1430114, 1443511, 1458471, 1470154, 1525243, 1527607, 1529903, 1535539, 1541345, 1543386, 1563715, 1563758, 1564092, 1566795, 1582378, 1595064, 1597672, 1595083",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
<br />
== Firefox 68.4 ESR ==<br />
=== Build 1 ===<br />
* 68.4.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/b9ced0dd1026bf43339ecd41b942d19f63ea72c6 b9ced0dd1026bf43339ecd41b942d19f63ea72c6]<br />
* Build ID: 20191230131429<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/23899 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1597794%2C1560808%2C1600122%2C1586453%2C1221256%2C1601701%2C1600007%2C1605867%2C1563581%2C1591880%2C1583525%2C1597963%2C1560660%2C1597792%2C1481916%2C1602843%2C1587534%2C1595470%2C1540921%2C1583471%2C1602601%2C1601344%2C1590984%2C1511073%2C1595123%2C1511604%2C1599181%2C1602280%2C1604295%2C1513855%2C1583735%2C1596778%2C1590907%2C1598337%2C1603055%2C1588183%2C1598605%2C1507180%2C1550815%2C1598040%2C1603313%2C1500321&list_id=15052980 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [TBD Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-localtest → [https://docs.google.com/spreadsheets/d/1dH40nxOLf8apF03Cq1ucqfwyz7iJYyXLfKYXCOVtWq4/edit#gid=850719639 report]<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1dH40nxOLf8apF03Cq1ucqfwyz7iJYyXLfKYXCOVtWq4/edit#gid=850719639 report]<br />
** {{mdone|}} esr → [https://docs.google.com/spreadsheets/d/1dH40nxOLf8apF03Cq1ucqfwyz7iJYyXLfKYXCOVtWq4/edit#gid=850719639 report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1606797",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"839074, 932289, 1018882, 1037792, 1053819, 1144124, 1194214, 1282075, 1306270, 1349217, 1360545, 1368158, 1370743, 1393460, 1411224, 1427280, 1430114, 1440641, 1470409, 1528958, 1529903, 1541376, 1543386, 1560955, 1563528, 1563758, 1564092, 1574461, 1595064, 1597672, 1602419, 1604504, 1606098",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
<br />
== Firefox 68.4.1 ESR ==<br />
=== Build 1 ===<br />
* 68.4.1esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/8b51bf38ddbb00131188d833c1441bb37128634b 8b51bf38ddbb00131188d833c1441bb37128634b]<br />
* Build ID: 20200107212959<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/24166 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1603268%2C1601905%2C1606869%2C1603270%2C1604490%2C1603275%2C1583565%2C1604249%2C1605073%2C1607443&list_id=15060393 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1xJf2awdf_ZVSZRplSt753fWvEWYjtJWvdrVwhcweX5w/edit?usp=sharing report]<br />
** {{mdone|}} esr → [https://docs.google.com/spreadsheets/d/1xJf2awdf_ZVSZRplSt753fWvEWYjtJWvdrVwhcweX5w/edit?usp=sharing report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1498112, 1555695, 1563715, 1606797",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.4.2 ESR ==<br />
=== Build 1 ===<br />
* 68.4.2esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/e215d711213984716b1c44db7d1254397de6ef4b e215d711213984716b1c44db7d1254397de6ef4b]<br />
* Build ID: 20200117153614<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/24660 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1603268%2C1601905%2C1606869%2C1603270%2C1604490%2C1603275%2C1583565%2C1604249%2C1605073%2C1607443&list_id=15060393 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1xJf2awdf_ZVSZRplSt753fWvEWYjtJWvdrVwhcweX5w/edit?usp=sharing report]<br />
** {{mprog|}} esr → [https://docs.google.com/spreadsheets/d/1xJf2awdf_ZVSZRplSt753fWvEWYjtJWvdrVwhcweX5w/edit?usp=sharing report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1309534, 1393460, 1458470, 1498112, 1543386, 1606797",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1222557
Releases/Firefox 72/Test Plan
2020-01-20T15:07:12Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 72 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 72 are available [https://docs.google.com/spreadsheets/d/1px85HjaQHgpfq68bdMBbhusIsEZXmP_Ig3_KlAoyFRc/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build3 (https://hg.mozilla.org/releases/mozilla-release/rev/d88c5f2e59dccf2bfd345e66e548f2f245561a00 d88c5f2e59dccf2bfd345e66e548f2f245561a00], 20200102182448) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{notstarted|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23975 TestRail]<br />
*** {{notstarted|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{inprogress|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{notstarted|}} release-cdntest, beta-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{notstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">72.0.1</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/8260da04c9b1 8260da04c9b1], 20200107212822) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24161 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Chempsill bug]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">72.0.2</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0.2-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/25e0edbb0a613c3bf794c93ba3aa0985d29d5ef4 25e0edbb0a613c3bf794c93ba3aa0985d29d5ef4], 20200117190643) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24655 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1601905%201602726%201604249%201604490%201607494%201608478&list_id=15077106 Driver bugs]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1b-z9PvqohA47-DiUUi9fZbDv8B_nxk2hUlyDjfhyqlw/edit#gid=850719639 report]<br />
*** {{mprog|}} release → [https://docs.google.com/spreadsheets/d/1b-z9PvqohA47-DiUUi9fZbDv8B_nxk2hUlyDjfhyqlw/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1222550
Releases/Firefox 72/Test Plan
2020-01-20T15:02:40Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 72 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 72 are available [https://docs.google.com/spreadsheets/d/1px85HjaQHgpfq68bdMBbhusIsEZXmP_Ig3_KlAoyFRc/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build3 (https://hg.mozilla.org/releases/mozilla-release/rev/d88c5f2e59dccf2bfd345e66e548f2f245561a00 d88c5f2e59dccf2bfd345e66e548f2f245561a00], 20200102182448) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{notstarted|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23975 TestRail]<br />
*** {{notstarted|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{inprogress|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{notstarted|}} release-cdntest, beta-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{notstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">72.0.1</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/8260da04c9b1 8260da04c9b1], 20200107212822) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24161 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Chempsill bug]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">72.0.2</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0.2-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/25e0edbb0a613c3bf794c93ba3aa0985d29d5ef4 25e0edbb0a613c3bf794c93ba3aa0985d29d5ef4], 20200117190643) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24655 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Chempsill bug]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1b-z9PvqohA47-DiUUi9fZbDv8B_nxk2hUlyDjfhyqlw/edit#gid=850719639 report]<br />
*** {{mprog|}} release → [https://docs.google.com/spreadsheets/d/1b-z9PvqohA47-DiUUi9fZbDv8B_nxk2hUlyDjfhyqlw/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1222238
Releases/Firefox 73/Test Plan
2020-01-13T13:10:24Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e592eb8fc8c2b5a7fd971c1430c70de8f058a071 e592eb8fc8c2b5a7fd971c1430c70de8f058a071], 20200110003145) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Geolocation''', '''Form Autofill''', '''Password Manager 2.0''', '''Preferences ''', '''Notifications, Push Notifications and Alerts''', '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24268 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/u/1/d/1tl2K8XD9gwrMASHwIJ6dcmkV4bEZQD1mVhHm2U0Yn9Y/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/599d3e91827c8c124e9345fb88ba42b7a238b75d 599d3e91827c8c124e9345fb88ba42b7a238b75d], 20200112220634) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Startup and Profile''', '''Downloads''', '''Security and Privacy''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24315 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1qJA1xAWNH6qsEZevnQ3QkUxmSD-No3ojNoQu8APyIac/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1222070
Releases/Firefox 73/Test Plan
2020-01-08T15:21:56Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1222069
Releases/Firefox 73/Test Plan
2020-01-08T15:21:13Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">Done</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">Done</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1293702786 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1222068
Releases/Firefox 73/Test Plan
2020-01-08T15:20:20Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">Done</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">73.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/4ec2c9a971e1a9a49b5f24a59343fba245470a91 4ec2c9a971e1a9a49b5f24a59343fba245470a91], 20200107212705) - <font style="color:green; font-weight:bold;">Done</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Security and Privacy ''', '''Theme and Toolbar Customization''', '''Browser Window''', '''Bookmarks and History''', '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24132 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1FqUHR7nggpa0S4r1693Hhnl9x3fX-8wV0k9jeSHT6F0/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1222067
Releases/Firefox 72/Test Plan
2020-01-08T15:05:51Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 72 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 72 are available [https://docs.google.com/spreadsheets/d/1px85HjaQHgpfq68bdMBbhusIsEZXmP_Ig3_KlAoyFRc/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build3 (https://hg.mozilla.org/releases/mozilla-release/rev/d88c5f2e59dccf2bfd345e66e548f2f245561a00 d88c5f2e59dccf2bfd345e66e548f2f245561a00], 20200102182448) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{notstarted|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23975 TestRail]<br />
*** {{notstarted|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{inprogress|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{notstarted|}} release-cdntest, beta-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{notstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">72.0.1</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/8260da04c9b1 8260da04c9b1], 20200107212822) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24161 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Chempsill bug]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
*** {{notstarted|}} release → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1222066
Releases/Firefox 72/Test Plan
2020-01-08T15:03:45Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 72 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 72 are available [https://docs.google.com/spreadsheets/d/1px85HjaQHgpfq68bdMBbhusIsEZXmP_Ig3_KlAoyFRc/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build3 (https://hg.mozilla.org/releases/mozilla-release/rev/d88c5f2e59dccf2bfd345e66e548f2f245561a00 d88c5f2e59dccf2bfd345e66e548f2f245561a00], 20200102182448) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{notstarted|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23975 TestRail]<br />
*** {{notstarted|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{inprogress|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{notstarted|}} release-cdntest, beta-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{notstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">72.0.1</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/8260da04c9b13f7c0e9cc6984a75e689b5fcb8c8 8260da04c9b13f7c0e9cc6984a75e689b5fcb8c8], 20200107212822) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24161 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Chempsill bug]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
*** {{notstarted|}} release → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1222065
Releases/Firefox 72/Test Plan
2020-01-08T15:03:04Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 72 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 72 are available [https://docs.google.com/spreadsheets/d/1px85HjaQHgpfq68bdMBbhusIsEZXmP_Ig3_KlAoyFRc/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build3 (https://hg.mozilla.org/releases/mozilla-release/rev/d88c5f2e59dccf2bfd345e66e548f2f245561a00 d88c5f2e59dccf2bfd345e66e548f2f245561a00], 20200102182448) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{notstarted|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23975 TestRail]<br />
*** {{notstarted|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{inprogress|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{notstarted|}} release-cdntest, beta-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{notstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 72.0.1</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0.1-build1 (https://hg.mozilla.org/releases/mozilla-release/rev/8260da04c9b13f7c0e9cc6984a75e689b5fcb8c8 8260da04c9b13f7c0e9cc6984a75e689b5fcb8c8], 20200107212822) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24161 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Chempsill bug]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
*** {{notstarted|}} release → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1222064
Releases/Firefox 72/Test Plan
2020-01-08T15:02:11Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 72 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 72 are available [https://docs.google.com/spreadsheets/d/1px85HjaQHgpfq68bdMBbhusIsEZXmP_Ig3_KlAoyFRc/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build3 (https://hg.mozilla.org/releases/mozilla-release/rev/d88c5f2e59dccf2bfd345e66e548f2f245561a00 d88c5f2e59dccf2bfd345e66e548f2f245561a00], 20200102182448) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{notstarted|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23975 TestRail]<br />
*** {{notstarted|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{inprogress|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{notstarted|}} release-cdntest, beta-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{notstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 72.0.1</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0.1-build1 (https://hg.mozilla.org/releases/mozilla-release/rev/8260da04c9b13f7c0e9cc6984a75e689b5fcb8c8 8260da04c9b13f7c0e9cc6984a75e689b5fcb8c8], 20200107212822) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{notstarted|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24161 TestRail]<br />
*** {{notstarted|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{inprogress|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{notstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
*** {{notstarted|}} release → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_73/Test_Plan&diff=1222002
Releases/Firefox 73/Test Plan
2020-01-08T07:05:47Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 73 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 73 are available [https://docs.google.com/spreadsheets/u/1/d/1sWCwfJGLMY0WC1C3Y8X8XYaOHDP3tQPRu3LNZnDsZ1Q/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 73 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1(2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [- report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 73.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 73 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">N.A.</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''' , '''OS Integration''' , '''User Profile''' , '''Form Autofill''' , '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 73.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6 ea93a9ceeea1a0b8cacb5c9038e1fa1d00e50bc6], 20200106175743) - <font style="color:green; font-weight:bold;">Done</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Tabbed Browser''', '''OS Integration''', '''User Profile''', '''Form Autofill''', '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/24041 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221723
Releases/Firefox 72/Test Plan
2019-12-31T13:06:41Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221722
Releases/Firefox 72/Test Plan
2019-12-31T13:05:59Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&action=edit&section=24 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&action=edit&section=24 report]<br />
*** {{mnotstarted|}} release → [https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&action=edit&section=24 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221721
Releases/Firefox 72/Test Plan
2019-12-31T13:05:39Z
<p>Bogdan.maris: /* Release 72 build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Release 72 build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div><br />
<div class="mw-collapsible-content"><br />
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-localtest → [https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&action=edit&section=24 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&action=edit&section=24 report]<br />
*** {{mnotstarted|}} release → [https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&action=edit&section=24 report]<br />
*** {{mdone|}} beta→ [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221620
Releases/Firefox 72/Test Plan
2019-12-23T16:00:15Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221619
Releases/Firefox 72/Test Plan
2019-12-23T15:59:53Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221618
Releases/Firefox 72/Test Plan
2019-12-23T15:56:55Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221596
Releases/Firefox 72/Test Plan
2019-12-20T16:01:30Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221595
Releases/Firefox 72/Test Plan
2019-12-20T16:01:00Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''' ,'''Preferences''','''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221593
Releases/Firefox 72/Test Plan
2019-12-20T16:00:26Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
=== Developer Edition build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b4</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail]<br />
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke testing on '''Password Manager''' ,'''Preferences''','''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221046
Releases/Firefox 72/Test Plan
2019-12-06T15:10:26Z
<p>Bogdan.maris: /* Beta 72 milestones */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Smoke, Regression and Exploratory testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_72/Test_Plan&diff=1221045
Releases/Firefox 72/Test Plan
2019-12-06T15:09:20Z
<p>Bogdan.maris: /* Beta/DevEdition build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 73.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta 72 milestones ==<br />
=== Beta/DevEdition build readiness ===<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/u/1/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
*** {{done|}} aurora → [https://docs.google.com/spreadsheets/d/1cuPLzKaqOQEQRd3chASRGgIWFEgPp3a6yauUxurM8hg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Smoke, Regression and Exploratory testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
*** {{mdone|}} aurora → [https://docs.google.com/spreadsheets/d/1jOS2FkwLZ4yNZNHJEYccwphgj8bPWLv8jXDqwZ92Z90/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_71/Test_Plan&diff=1220460
Releases/Firefox 71/Test Plan
2019-11-19T15:48:35Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 71 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e1479d4d94da e1479d4d94da], 20191014171118) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''' and '''Startup and Profile''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21483 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1zRLAU64Z3jFnjXd-bf2wjC3jGVx-uciKUW0CCxD1p24/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1zRLAU64Z3jFnjXd-bf2wjC3jGVx-uciKUW0CCxD1p24/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d743fd9d6bd 5d743fd9d6bd], 20191016150816) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21688 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1wpOCj4i7s2PIQCjIRvhZHac4ZeRua3Xssw5b-W7h98M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1wpOCj4i7s2PIQCjIRvhZHac4ZeRua3Xssw5b-W7h98M/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8436f40e05c0 8436f40e05c0], 20191104135555) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22281 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/-- --], --) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21728 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2109 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5a8eb9b5da997aa995a4aa6199ba37bbb581063 d5a8eb9b5da997aa995a4aa6199ba37bbb581063], 20191024095932) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''', '''Downloads''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21794 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21795 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/105200ed1cf6753d13dbeecc4bbb9e4837b7711d 105200ed1cf6753d13dbeecc4bbb9e4837b7711d], 20191028110005) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''', '''Installer''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21833 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21850 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/abe7cbe63f04be2e33810e6fa757fa73e257c4d0 abe7cbe63f04be2e33810e6fa757fa73e257c4d0], 20191031113544) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Audio/Video''', '''Search''', '''Address Bar''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22148 TestRail]<br />
*** {{mprog|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21850 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1N0V5DH7Y-A5sOBXILwbodKzkMzZK2wWyRCjG-4ZzDi8/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 aa565b96885044b65e176acc9e3286e81eb0abe5], 20191107101713) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Bookmarks and History''', ''Scrolling, Panning and Zooming''', and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22148 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22231 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 aa565b96885044b65e176acc9e3286e81eb0abe5], 20191107101713) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Bookmarks and History''', '''WebExtensions''', '''PDF Viewer''', '''Printing''', and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22306 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22303 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 271f87528b864c091e90fee8f4cc8cbcdb36cef9.], 20191111170815) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Graphics''', '''Images''', '''Data Migration''', and '''Plugins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22391 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22415 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/992520c31cde6750358c5d5c3a610f77ebadd404 992520c31cde6750358c5d5c3a610f77ebadd404.], 20191114160003) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Audio/Video''', '''Crash Reporting''', '''Startup and Profile''', and '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22456 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22478 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5c921325dd03885c3392512722c7cede4ed9e00e 5c921325dd03885c3392512722c7cede4ed9e00e], 20191118154140) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Geolocation''', '''Preferences''' and '''Address Bar and Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22524 TestRail]<br />
*** {{mnotstarted|}} Smoke testing on Ubuntu snap package → [https://bugzil.la/1596135 Blocked by bug 1596135]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://drive.google.com/open?id=1Nty71QYYta6lIUKVjuFwn4xX7IZH4tfjI51H_nfMKFk report]<br />
*** {{mdone|}} beta, aurora → [https://drive.google.com/open?id=1Nty71QYYta6lIUKVjuFwn4xX7IZH4tfjI51H_nfMKFk report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_71/Test_Plan&diff=1220459
Releases/Firefox 71/Test Plan
2019-11-19T15:47:39Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 71 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e1479d4d94da e1479d4d94da], 20191014171118) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''' and '''Startup and Profile''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21483 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1zRLAU64Z3jFnjXd-bf2wjC3jGVx-uciKUW0CCxD1p24/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1zRLAU64Z3jFnjXd-bf2wjC3jGVx-uciKUW0CCxD1p24/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d743fd9d6bd 5d743fd9d6bd], 20191016150816) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21688 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1wpOCj4i7s2PIQCjIRvhZHac4ZeRua3Xssw5b-W7h98M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1wpOCj4i7s2PIQCjIRvhZHac4ZeRua3Xssw5b-W7h98M/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8436f40e05c0 8436f40e05c0], 20191104135555) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22281 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/-- --], --) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21728 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2109 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5a8eb9b5da997aa995a4aa6199ba37bbb581063 d5a8eb9b5da997aa995a4aa6199ba37bbb581063], 20191024095932) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''', '''Downloads''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21794 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21795 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/105200ed1cf6753d13dbeecc4bbb9e4837b7711d 105200ed1cf6753d13dbeecc4bbb9e4837b7711d], 20191028110005) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''', '''Installer''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21833 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21850 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/abe7cbe63f04be2e33810e6fa757fa73e257c4d0 abe7cbe63f04be2e33810e6fa757fa73e257c4d0], 20191031113544) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Audio/Video''', '''Search''', '''Address Bar''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22148 TestRail]<br />
*** {{mprog|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21850 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1N0V5DH7Y-A5sOBXILwbodKzkMzZK2wWyRCjG-4ZzDi8/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 aa565b96885044b65e176acc9e3286e81eb0abe5], 20191107101713) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Bookmarks and History''', ''Scrolling, Panning and Zooming''', and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22148 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22231 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 aa565b96885044b65e176acc9e3286e81eb0abe5], 20191107101713) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Bookmarks and History''', '''WebExtensions''', '''PDF Viewer''', '''Printing''', and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22306 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22303 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 271f87528b864c091e90fee8f4cc8cbcdb36cef9.], 20191111170815) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Graphics''', '''Images''', '''Data Migration''', and '''Plugins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22391 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22415 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/992520c31cde6750358c5d5c3a610f77ebadd404 992520c31cde6750358c5d5c3a610f77ebadd404.], 20191114160003) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Audio/Video''', '''Crash Reporting''', '''Startup and Profile''', and '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22456 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22478 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5c921325dd03885c3392512722c7cede4ed9e00e 5c921325dd03885c3392512722c7cede4ed9e00e], 20191118154140) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Geolocation''', '''Preferences''' and '''Address Bar and Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22524 TestRail]<br />
*** {{mnotsarted|}} Smoke testing on Ubuntu snap package → [Blocked by bug 1596135 https://bugzil.la/1596135]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://drive.google.com/open?id=1Nty71QYYta6lIUKVjuFwn4xX7IZH4tfjI51H_nfMKFk report]<br />
*** {{mdone|}} beta, aurora → [https://drive.google.com/open?id=1Nty71QYYta6lIUKVjuFwn4xX7IZH4tfjI51H_nfMKFk report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_71/Test_Plan&diff=1220458
Releases/Firefox 71/Test Plan
2019-11-19T15:47:07Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 71 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e1479d4d94da e1479d4d94da], 20191014171118) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''' and '''Startup and Profile''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21483 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1zRLAU64Z3jFnjXd-bf2wjC3jGVx-uciKUW0CCxD1p24/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1zRLAU64Z3jFnjXd-bf2wjC3jGVx-uciKUW0CCxD1p24/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d743fd9d6bd 5d743fd9d6bd], 20191016150816) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Audio/Video''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21688 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1wpOCj4i7s2PIQCjIRvhZHac4ZeRua3Xssw5b-W7h98M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1wpOCj4i7s2PIQCjIRvhZHac4ZeRua3Xssw5b-W7h98M/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 71.0b7</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 71.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8436f40e05c0 8436f40e05c0], 20191104135555) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22281 TestRail]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/-- --], --) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21728 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2109 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1QgsQx8TADMc85wxLDAqEIXbje_ZsPw2XieSOvhx1RnA/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5a8eb9b5da997aa995a4aa6199ba37bbb581063 d5a8eb9b5da997aa995a4aa6199ba37bbb581063], 20191024095932) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''', '''Downloads''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21794 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21795 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1x9BjPaPzmlMaMltYJxxReLdPxHa19wVldhBYCU1ttHE/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/105200ed1cf6753d13dbeecc4bbb9e4837b7711d 105200ed1cf6753d13dbeecc4bbb9e4837b7711d], 20191028110005) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''', '''Installer''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21833 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21850 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/abe7cbe63f04be2e33810e6fa757fa73e257c4d0 abe7cbe63f04be2e33810e6fa757fa73e257c4d0], 20191031113544) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Audio/Video''', '''Search''', '''Address Bar''' and '''Preferences''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22148 TestRail]<br />
*** {{mprog|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21850 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1N0V5DH7Y-A5sOBXILwbodKzkMzZK2wWyRCjG-4ZzDi8/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1wn_3r4jb19ubHL1CzwgP7uWSbdfD9mz8xlM3IQaIk6k/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 aa565b96885044b65e176acc9e3286e81eb0abe5], 20191107101713) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Bookmarks and History''', ''Scrolling, Panning and Zooming''', and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22148 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22231 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1VHaHfrnqwXvvE-sWeQyn4ErN5JdHQCYmfIN9PnkntLU/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 aa565b96885044b65e176acc9e3286e81eb0abe5], 20191107101713) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Bookmarks and History''', '''WebExtensions''', '''PDF Viewer''', '''Printing''', and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22306 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22303 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1NHhso4zTqW2_64It9UHsp5xI2YCplFkrESj5FHwb39g/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/aa565b96885044b65e176acc9e3286e81eb0abe5 271f87528b864c091e90fee8f4cc8cbcdb36cef9.], 20191111170815) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Graphics''', '''Images''', '''Data Migration''', and '''Plugins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22391 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22415 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/992520c31cde6750358c5d5c3a610f77ebadd404 992520c31cde6750358c5d5c3a610f77ebadd404.], 20191114160003) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Audio/Video''', '''Crash Reporting''', '''Startup and Profile''', and '''OS Integration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22456 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22478 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1vUgfXo4iUSXkuhmIvBmbmvaeVw1m87DkpLTNKxR9ZYQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 71.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 71.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5c921325dd03885c3392512722c7cede4ed9e00e 5c921325dd03885c3392512722c7cede4ed9e00e], 20191118154140) - <font style="color:green; font-weight:bold;">GREEN</font><br />
*** {{mdone|}} Smoke testing on '''Installer''', '''Geolocation''', '''Preferences''' and '''Address Bar and Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22524 TestRail]<br />
*** {{dropped|}} Smoke testing on Ubuntu snap package → [Blocked by bug 1596135 https://bugzil.la/1596135]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://drive.google.com/open?id=1Nty71QYYta6lIUKVjuFwn4xX7IZH4tfjI51H_nfMKFk report]<br />
*** {{mdone|}} beta, aurora → [https://drive.google.com/open?id=1Nty71QYYta6lIUKVjuFwn4xX7IZH4tfjI51H_nfMKFk report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_70/Test_Plan&diff=1219719
Releases/Firefox 70/Test Plan
2019-10-31T14:59:52Z
<p>Bogdan.maris: /* Release 70 milestones */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 69 are available [https://docs.google.com/spreadsheets/d/10iNQQ2tmr0FP49bqmAi66-4qhSjKiW5e6wNQ47E-P9A/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 71 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1554912, 1555113<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1360545%2C%201354992%2C%201544509%2C%201370743%2C%201554597%2C%201554720%2C%201541376%2C%201430114%2C%201554912%2C%201515289%2C%201393460%2C%201525585%2C%201441881%2C%201443511%2C%201525607%2C%201194214%2C%201282075%2C%201512611%2C%201396732%2C%201555113%2C%201458885%2C%201144124%2C%201037792%2C%20839074%2C%201395520&bug_id_type=anyexact&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766805 bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1558762<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201393460%2C%201282075%2C%201194214%2C%201539182%2C%201525585%2C%201551534%2C%201528958%2C%201198363%2C%201511869%2C%201441881%2C%201443511%2C%201512611%2C%201536449%2C%201555834%2C%201354992%2C%201545115%2C%201460873%2C%201224550%2C%201364669%2C%201418954%2C%201503269%2C%201273604%2C%201525607%2C%201558762%2C%201396732%2C%201544701%2C%201210769%2C%201427280%2C%201370743%2C%201558753%2C%201544509%2C%201558762&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766809 bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 70 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2c2cb0df9517 2c2cb0df9517], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20010 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mblocked|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b2-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/04d54c74a744 04d54c74a744], 20190830040415) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20206 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{done|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6 1021b3e283c6], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20448 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b5 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b5 update tests)<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086 48e74f990086], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20876 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b9 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b9 update tests)<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/82e9cab54ba65854416b316306a31f045bdb2321 82e9cab54ba65854416b316306a31f045bdb2321], 20190902191027) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b4-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e 5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e], 20190905174512) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Images''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/16e8HATyYUnDO_qy8uMnGJHM0xoYdhs9P3Q-naopGj5M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6eb34514b46ad600c42a647ad85a8 1021b3e283c6eb34514b46ad600c42a647ad85a8], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''WebExtensions''', '''Scrolling, Panning and Zooming''' and '''Geolocation ''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20404 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20428 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/bb9376d19d79 bb9376d19d79], 20190912160217) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''' and '''Password Manager & Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20572 TestRail]<br />
*** {{done|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1995 TestRail]<br />
*** {{done|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2771f6fe4899 2771f6fe4899], 20190916074538) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20668 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20675 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/45c0e8a9df93f545bfacf07e5a78bd69559c6adf 45c0e8a9df93f545bfacf07e5a78bd69559c6adf], 20190919164641) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Downloads''', '''Installer''' and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20745]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20761 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086920697ec7b6d3a6ff95554de390f 48e74f990086920697ec7b6d3a6ff95554de390f], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Password Manager''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20859 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20848 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa 6f62baa8eaaa], 20190926005616) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' and '''Anti-Tracking''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20926 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20939 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa e8e31000eab2], 20190930132843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21027 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b12</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/24de1dfb6086 24de1dfb6086], 20191002212950) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''OS Integration''', '''Data migration''' and '''History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21125 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b13</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b13-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5757a036a4e8146e29b6eb487d708c9c40fcb36c], 20191007220302) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''PDF Viewer''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21237 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21172 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Uh9eO9IBoQyozTN2umvvslps7zjOQyfybxRJkp2dvWA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1naMRDRVlrj5--LTKKHw8bHYWqlyYogCgFlez7CYGV2o/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b14</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b14-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d7ecb0646db 5d7ecb0646db], 20191010142853) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Session Restore''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21356 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21367 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
== Release 70 milestones ==<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/0eae18af659f 0eae18af659f], 20191014163058) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2090 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → report<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → report<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1585499%201586216&list_id=14941422 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build2 ([https://hg.mozilla.org/releases/mozilla-release/rev/990d9f90f0f5 990d9f90f0f5], 20191016161957) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21579 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21577 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1OSm-w1mxPKRldYfscp4duJ9NbzSjxPurIgmmo9AD45o/edit?pli=1 report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1576508%201586627&list_id=14946130 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/1cLYMBGE49_0hbwXz8USBDBIDy2noylValqo5CIOWLbs/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → [https://docs.google.com/spreadsheets/d/1cLYMBGE49_0hbwXz8USBDBIDy2noylValqo5CIOWLbs/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC 70.0.1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/21ce5fdd3146 21ce5fdd3146], 20191030021342) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22074 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2121 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1On4Qnt5xNWe9M9beec389SWFNYjSgIrW_3WIZ4w_tfI/edit# report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1585236%201586090%201587543%201588747%201589441%201589972%201590479%201592136&list_id=14968861 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://drive.google.com/open?id=1sQLfFO3_3SBQt4HYB0o5XJHNVCd-NcfE9rAdolk6B9k report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1sQLfFO3_3SBQt4HYB0o5XJHNVCd-NcfE9rAdolk6B9k report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_70/Test_Plan&diff=1219718
Releases/Firefox 70/Test Plan
2019-10-31T14:53:21Z
<p>Bogdan.maris: /* Release 70 milestones */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 69 are available [https://docs.google.com/spreadsheets/d/10iNQQ2tmr0FP49bqmAi66-4qhSjKiW5e6wNQ47E-P9A/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 71 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1554912, 1555113<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1360545%2C%201354992%2C%201544509%2C%201370743%2C%201554597%2C%201554720%2C%201541376%2C%201430114%2C%201554912%2C%201515289%2C%201393460%2C%201525585%2C%201441881%2C%201443511%2C%201525607%2C%201194214%2C%201282075%2C%201512611%2C%201396732%2C%201555113%2C%201458885%2C%201144124%2C%201037792%2C%20839074%2C%201395520&bug_id_type=anyexact&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766805 bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1558762<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201393460%2C%201282075%2C%201194214%2C%201539182%2C%201525585%2C%201551534%2C%201528958%2C%201198363%2C%201511869%2C%201441881%2C%201443511%2C%201512611%2C%201536449%2C%201555834%2C%201354992%2C%201545115%2C%201460873%2C%201224550%2C%201364669%2C%201418954%2C%201503269%2C%201273604%2C%201525607%2C%201558762%2C%201396732%2C%201544701%2C%201210769%2C%201427280%2C%201370743%2C%201558753%2C%201544509%2C%201558762&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766809 bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 70 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2c2cb0df9517 2c2cb0df9517], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20010 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mblocked|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b2-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/04d54c74a744 04d54c74a744], 20190830040415) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20206 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{done|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6 1021b3e283c6], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20448 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b5 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b5 update tests)<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086 48e74f990086], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20876 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b9 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b9 update tests)<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/82e9cab54ba65854416b316306a31f045bdb2321 82e9cab54ba65854416b316306a31f045bdb2321], 20190902191027) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b4-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e 5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e], 20190905174512) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Images''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/16e8HATyYUnDO_qy8uMnGJHM0xoYdhs9P3Q-naopGj5M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6eb34514b46ad600c42a647ad85a8 1021b3e283c6eb34514b46ad600c42a647ad85a8], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''WebExtensions''', '''Scrolling, Panning and Zooming''' and '''Geolocation ''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20404 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20428 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/bb9376d19d79 bb9376d19d79], 20190912160217) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''' and '''Password Manager & Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20572 TestRail]<br />
*** {{done|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1995 TestRail]<br />
*** {{done|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2771f6fe4899 2771f6fe4899], 20190916074538) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20668 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20675 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/45c0e8a9df93f545bfacf07e5a78bd69559c6adf 45c0e8a9df93f545bfacf07e5a78bd69559c6adf], 20190919164641) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Downloads''', '''Installer''' and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20745]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20761 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086920697ec7b6d3a6ff95554de390f 48e74f990086920697ec7b6d3a6ff95554de390f], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Password Manager''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20859 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20848 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa 6f62baa8eaaa], 20190926005616) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' and '''Anti-Tracking''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20926 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20939 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa e8e31000eab2], 20190930132843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21027 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b12</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/24de1dfb6086 24de1dfb6086], 20191002212950) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''OS Integration''', '''Data migration''' and '''History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21125 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b13</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b13-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5757a036a4e8146e29b6eb487d708c9c40fcb36c], 20191007220302) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''PDF Viewer''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21237 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21172 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Uh9eO9IBoQyozTN2umvvslps7zjOQyfybxRJkp2dvWA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1naMRDRVlrj5--LTKKHw8bHYWqlyYogCgFlez7CYGV2o/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b14</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b14-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d7ecb0646db 5d7ecb0646db], 20191010142853) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Session Restore''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21356 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21367 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
== Release 70 milestones ==<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/0eae18af659f 0eae18af659f], 20191014163058) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2090 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → report<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → report<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1585499%201586216&list_id=14941422 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build2 ([https://hg.mozilla.org/releases/mozilla-release/rev/990d9f90f0f5 990d9f90f0f5], 20191016161957) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21579 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21577 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1OSm-w1mxPKRldYfscp4duJ9NbzSjxPurIgmmo9AD45o/edit?pli=1 report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1576508%201586627&list_id=14946130 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/1cLYMBGE49_0hbwXz8USBDBIDy2noylValqo5CIOWLbs/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → [https://docs.google.com/spreadsheets/d/1cLYMBGE49_0hbwXz8USBDBIDy2noylValqo5CIOWLbs/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC 70.0.1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/21ce5fdd3146 21ce5fdd3146], 20191030021342) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22074 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22071 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1On4Qnt5xNWe9M9beec389SWFNYjSgIrW_3WIZ4w_tfI/edit# report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1585236%201586090%201587543%201588747%201589441%201589972%201590479%201592136&list_id=14968861 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://drive.google.com/open?id=1sQLfFO3_3SBQt4HYB0o5XJHNVCd-NcfE9rAdolk6B9k report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1sQLfFO3_3SBQt4HYB0o5XJHNVCd-NcfE9rAdolk6B9k report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_70/Test_Plan&diff=1219717
Releases/Firefox 70/Test Plan
2019-10-31T14:51:41Z
<p>Bogdan.maris: /* Release 70 milestones */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 69 are available [https://docs.google.com/spreadsheets/d/10iNQQ2tmr0FP49bqmAi66-4qhSjKiW5e6wNQ47E-P9A/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 71 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1554912, 1555113<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1360545%2C%201354992%2C%201544509%2C%201370743%2C%201554597%2C%201554720%2C%201541376%2C%201430114%2C%201554912%2C%201515289%2C%201393460%2C%201525585%2C%201441881%2C%201443511%2C%201525607%2C%201194214%2C%201282075%2C%201512611%2C%201396732%2C%201555113%2C%201458885%2C%201144124%2C%201037792%2C%20839074%2C%201395520&bug_id_type=anyexact&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766805 bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1558762<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201393460%2C%201282075%2C%201194214%2C%201539182%2C%201525585%2C%201551534%2C%201528958%2C%201198363%2C%201511869%2C%201441881%2C%201443511%2C%201512611%2C%201536449%2C%201555834%2C%201354992%2C%201545115%2C%201460873%2C%201224550%2C%201364669%2C%201418954%2C%201503269%2C%201273604%2C%201525607%2C%201558762%2C%201396732%2C%201544701%2C%201210769%2C%201427280%2C%201370743%2C%201558753%2C%201544509%2C%201558762&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766809 bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 70 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2c2cb0df9517 2c2cb0df9517], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20010 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mblocked|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b2-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/04d54c74a744 04d54c74a744], 20190830040415) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20206 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{done|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6 1021b3e283c6], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20448 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b5 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b5 update tests)<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086 48e74f990086], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20876 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b9 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b9 update tests)<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/82e9cab54ba65854416b316306a31f045bdb2321 82e9cab54ba65854416b316306a31f045bdb2321], 20190902191027) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b4-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e 5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e], 20190905174512) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Images''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/16e8HATyYUnDO_qy8uMnGJHM0xoYdhs9P3Q-naopGj5M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6eb34514b46ad600c42a647ad85a8 1021b3e283c6eb34514b46ad600c42a647ad85a8], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''WebExtensions''', '''Scrolling, Panning and Zooming''' and '''Geolocation ''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20404 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20428 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/bb9376d19d79 bb9376d19d79], 20190912160217) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''' and '''Password Manager & Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20572 TestRail]<br />
*** {{done|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1995 TestRail]<br />
*** {{done|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2771f6fe4899 2771f6fe4899], 20190916074538) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20668 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20675 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/45c0e8a9df93f545bfacf07e5a78bd69559c6adf 45c0e8a9df93f545bfacf07e5a78bd69559c6adf], 20190919164641) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Downloads''', '''Installer''' and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20745]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20761 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086920697ec7b6d3a6ff95554de390f 48e74f990086920697ec7b6d3a6ff95554de390f], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Password Manager''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20859 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20848 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa 6f62baa8eaaa], 20190926005616) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' and '''Anti-Tracking''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20926 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20939 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa e8e31000eab2], 20190930132843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21027 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b12</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/24de1dfb6086 24de1dfb6086], 20191002212950) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''OS Integration''', '''Data migration''' and '''History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21125 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b13</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b13-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5757a036a4e8146e29b6eb487d708c9c40fcb36c], 20191007220302) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''PDF Viewer''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21237 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21172 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Uh9eO9IBoQyozTN2umvvslps7zjOQyfybxRJkp2dvWA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1naMRDRVlrj5--LTKKHw8bHYWqlyYogCgFlez7CYGV2o/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b14</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b14-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d7ecb0646db 5d7ecb0646db], 20191010142853) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Session Restore''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21356 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21367 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
== Release 70 milestones ==<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/0eae18af659f 0eae18af659f], 20191014163058) - Sign off_Status<br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2090 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → report<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → report<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1585499%201586216&list_id=14941422 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC2 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build2 ([https://hg.mozilla.org/releases/mozilla-release/rev/990d9f90f0f5 990d9f90f0f5], 20191016161957) - Sign off_Status<br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21579 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21577 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1OSm-w1mxPKRldYfscp4duJ9NbzSjxPurIgmmo9AD45o/edit?pli=1 report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1576508%201586627&list_id=14946130 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/1cLYMBGE49_0hbwXz8USBDBIDy2noylValqo5CIOWLbs/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → [https://docs.google.com/spreadsheets/d/1cLYMBGE49_0hbwXz8USBDBIDy2noylValqo5CIOWLbs/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC 70.0.1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/21ce5fdd3146 21ce5fdd3146], 20191030021342) - Sign off_Status<br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22074 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/22071 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1On4Qnt5xNWe9M9beec389SWFNYjSgIrW_3WIZ4w_tfI/edit# report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1585236%201586090%201587543%201588747%201589441%201589972%201590479%201592136&list_id=14968861 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://drive.google.com/open?id=1sQLfFO3_3SBQt4HYB0o5XJHNVCd-NcfE9rAdolk6B9k report]<br />
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1sQLfFO3_3SBQt4HYB0o5XJHNVCd-NcfE9rAdolk6B9k report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_68_ESR/Test_Plan&diff=1219273
Releases/Firefox 68 ESR/Test Plan
2019-10-18T14:09:40Z
<p>Bogdan.maris: /* Checklist */</p>
<hr />
<div>== Firefox 68.0 ESR ==<br />
=== Build 1 ===<br />
* 68.0.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/debdf96baee1d54d22415ca3981179264d342c47 debdf96baee1d54d22415ca3981179264d342c47]<br />
* Build ID: 20190704173630<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: navy; font-size: 80%; font-weight: bold">[ON TRACK]</font> Manual testing'''<br />
** {{done|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/18626 TestRail]<br />
** {{mnotstarted|}} Bug fix verification → [ Bugzilla]<br />
** {{mnotstarted|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[NOT APPLICABLE]</font> Update tests (manual)'''<br />
** out of scope, updates are not generated for the first ESR<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1563514, 1563707",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1277327, 1305028, 1305744, 1309534, 1393460, 1402827, 1413233, 1441128, 1441881, 1442613, 1459211, 1477796, 1480788, 1489853, 1491256, 1498112, 1515289, 1515667, 1528968, 1544422, 1551881, 1563514, 1563554, 1563707, 1563715, 1563758, 545940",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
=== Build 2 ===<br />
* 68.0esr-build2<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/501f4667334f 501f4667334f]<br />
* Build ID: 20190705221915<br />
<br />
==== Checklist ====<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Automated testing'''<br />
** {{mdone|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=501f4667334f Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/18795 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzil.la/1558299 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzil.la/1558299 Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[NOT APPLICABLE]</font> Update tests (manual)'''<br />
** out of scope, updates are not generated for the first ESR<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1309534, 1498112, 1563715",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.0.1 ESR ==<br />
=== Build 1 ===<br />
* 68.0.1esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/61219aed2735 61219aed2735]<br />
* Build ID: 20190717193731<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{done|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19062 TestRail]<br />
** {{done|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1553586%2C1556846%2C1558503%2C1565779%2C1566206&list_id=14810958 Bugzilla]<br />
** {{done|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1E5xv2xxUYrmZqXsbzfIOlASdsRlvnCrcHTlCBAK8yV8/edit#gid=850719639 report]<br />
** {{mnotstarted|}} esr → [https://docs.google.com/spreadsheets/d/1E5xv2xxUYrmZqXsbzfIOlASdsRlvnCrcHTlCBAK8yV8/edit#gid=850719639 report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":",",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1222711, 1309534, 1393460, 1402827, 1458470, 1458471, 1462334, 1498112, 1515289",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.0.2 ESR ==<br />
=== Build 1 ===<br />
* 68.0.2esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/f1258d45d4b5 f1258d45d4b5]<br />
* Build ID: 20190813155538<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19587 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1560228%2C%201565542%2C%201567614%2C%201569244&list_id=14850527 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[ON TRACK]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1M2qrcXQkn8w5TeHZLbFQow0Rgy4ltXZvSbgxKwbSdAA/edit?usp=sharing report]<br />
** {{mnotstarted|}} esr → [https://docs.google.com/spreadsheets/d/1M2qrcXQkn8w5TeHZLbFQow0Rgy4ltXZvSbgxKwbSdAA/edit?usp=sharing report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":",",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214,1393460,1528958,1563758,1566795,1566825",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.1 ESR ==<br />
=== Build 1 ===<br />
* 68.1.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/380fedbb18002297f1b233bd9c09764e59ddaa86 380fedbb18002297f1b233bd9c09764e59ddaa86]<br />
* Build ID: 20190826132627<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19983 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1428917%201538995%201558924%201563617%201568108%201568855&list_id=14867552 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-localtest → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
** {{mdone|}} esr → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"TBD",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"508606, 558178, 839074, 1037792, 1089326, 1144124, 1194214, 1195053, 1210769, 1230678, 1282075, 1300525, 1305744, 1309534, 1370743, 1393460, 1427280, 1430114, 1436015, 1458470, 1458471, 1470154, 1510235, 1521769, 1525243, 1529882, 1535539, 1541345, 1541376, 1563709, 1563715, 1563758, 1566795, 1572857",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.2 ESR ==<br />
=== Build 1 ===<br />
* 68.2.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/ce462a42d4f7aa92e526fab29baea17ab5985841 ce462a42d4f7aa92e526fab29baea17ab5985841]<br />
* Build ID: 20191016163237<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/21588 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1428917%201538995%201558924%201563617%201568108%201568855&list_id=14867552 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1581117%201574963%201565318%201563295%201585367%201580737%201577149%201575681%201575273%201574944%201573967%201572793%201583660%201578341%201566180%201564639&list_id=14947819 Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-localtest → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
** {{mnotstarted|}} esr-cdntest → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
** {{mnotstarted|}} esr → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"508606, 558178, 839074, 1037792, 1089326, 1144124, 1194214, 1195053, 1210769, 1230678, 1282075, 1300525, 1305744, 1309534, 1370743, 1393460, 1427280, 1430114, 1436015, 1458470, 1458471, 1470154, 1510235, 1521769, 1525243, 1529882, 1535539, 1541345, 1541376, 1563709, 1563715, 1563758, 1566795, 1572857",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_68_ESR/Test_Plan&diff=1219272
Releases/Firefox 68 ESR/Test Plan
2019-10-18T14:05:34Z
<p>Bogdan.maris: </p>
<hr />
<div>== Firefox 68.0 ESR ==<br />
=== Build 1 ===<br />
* 68.0.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/debdf96baee1d54d22415ca3981179264d342c47 debdf96baee1d54d22415ca3981179264d342c47]<br />
* Build ID: 20190704173630<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: navy; font-size: 80%; font-weight: bold">[ON TRACK]</font> Manual testing'''<br />
** {{done|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/18626 TestRail]<br />
** {{mnotstarted|}} Bug fix verification → [ Bugzilla]<br />
** {{mnotstarted|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[NOT APPLICABLE]</font> Update tests (manual)'''<br />
** out of scope, updates are not generated for the first ESR<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1563514, 1563707",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1277327, 1305028, 1305744, 1309534, 1393460, 1402827, 1413233, 1441128, 1441881, 1442613, 1459211, 1477796, 1480788, 1489853, 1491256, 1498112, 1515289, 1515667, 1528968, 1544422, 1551881, 1563514, 1563554, 1563707, 1563715, 1563758, 545940",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
=== Build 2 ===<br />
* 68.0esr-build2<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/501f4667334f 501f4667334f]<br />
* Build ID: 20190705221915<br />
<br />
==== Checklist ====<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Automated testing'''<br />
** {{mdone|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=501f4667334f Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/18795 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzil.la/1558299 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzil.la/1558299 Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[NOT APPLICABLE]</font> Update tests (manual)'''<br />
** out of scope, updates are not generated for the first ESR<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1309534, 1498112, 1563715",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.0.1 ESR ==<br />
=== Build 1 ===<br />
* 68.0.1esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/61219aed2735 61219aed2735]<br />
* Build ID: 20190717193731<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{done|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19062 TestRail]<br />
** {{done|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1553586%2C1556846%2C1558503%2C1565779%2C1566206&list_id=14810958 Bugzilla]<br />
** {{done|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1E5xv2xxUYrmZqXsbzfIOlASdsRlvnCrcHTlCBAK8yV8/edit#gid=850719639 report]<br />
** {{mnotstarted|}} esr → [https://docs.google.com/spreadsheets/d/1E5xv2xxUYrmZqXsbzfIOlASdsRlvnCrcHTlCBAK8yV8/edit#gid=850719639 report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":",",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214, 1222711, 1309534, 1393460, 1402827, 1458470, 1458471, 1462334, 1498112, 1515289",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.0.2 ESR ==<br />
=== Build 1 ===<br />
* 68.0.2esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/f1258d45d4b5 f1258d45d4b5]<br />
* Build ID: 20190813155538<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19587 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1560228%2C%201565542%2C%201567614%2C%201569244&list_id=14850527 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [Bugzilla]<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[ON TRACK]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1M2qrcXQkn8w5TeHZLbFQow0Rgy4ltXZvSbgxKwbSdAA/edit?usp=sharing report]<br />
** {{mnotstarted|}} esr → [https://docs.google.com/spreadsheets/d/1M2qrcXQkn8w5TeHZLbFQow0Rgy4ltXZvSbgxKwbSdAA/edit?usp=sharing report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":",",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"1194214,1393460,1528958,1563758,1566795,1566825",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.1 ESR ==<br />
=== Build 1 ===<br />
* 68.1.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/380fedbb18002297f1b233bd9c09764e59ddaa86 380fedbb18002297f1b233bd9c09764e59ddaa86]<br />
* Build ID: 20190826132627<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/19983 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1428917%201538995%201558924%201563617%201568108%201568855&list_id=14867552 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [ Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-localtest → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
** {{mdone|}} esr-cdntest → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
** {{mdone|}} esr → [https://docs.google.com/spreadsheets/d/1-GWLEXws_-83QBGa_VDyUJ2hhas8pGWtAatsZYQOE4k/edit?usp=sharing report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"TBD",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"508606, 558178, 839074, 1037792, 1089326, 1144124, 1194214, 1195053, 1210769, 1230678, 1282075, 1300525, 1305744, 1309534, 1370743, 1393460, 1427280, 1430114, 1436015, 1458470, 1458471, 1470154, 1510235, 1521769, 1525243, 1529882, 1535539, 1541345, 1541376, 1563709, 1563715, 1563758, 1566795, 1572857",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
<br />
== Firefox 68.2 ESR ==<br />
=== Build 1 ===<br />
* 68.2.0esr-build1<br />
* Commit: [https://hg.mozilla.org/releases/mozilla-esr68/rev/ce462a42d4f7aa92e526fab29baea17ab5985841 ce462a42d4f7aa92e526fab29baea17ab5985841]<br />
* Build ID: 20191016163237<br />
<br />
==== Checklist ====<br />
* '''<font style="color: gray; font-size: 80%; font-weight: bold">[TBD]</font> Automated testing'''<br />
** {{mnotstarted|}} Functional Testing → [https://treeherder.mozilla.org/#/jobs?repo=mozilla-esr68&revision=tbd Treeherder]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Manual testing'''<br />
** {{mdone|}} Smoke and Exploratory Testing → [https://testrail.stage.mozaws.net/index.php?/plans/view/21588 TestRail]<br />
** {{mdone|}} Bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1428917%201538995%201558924%201563617%201568108%201568855&list_id=14867552 Bugzilla]<br />
** {{mdone|}} Security bug fix verification → [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1581117%201574963%201565318%201563295%201585367%201580737%201577149%201575681%201575273%201574944%201573967%201572793%201583660%201578341%201566180%201564639&list_id=14947819 Bugzilla]<br />
* '''<font style="color: green; font-size: 80%; font-weight: bold">[DONE]</font> Update tests (manual)'''<br />
** {{mdone|}} esr-localtest → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
** {{mdone|}} esr-cdntest → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
** {{mdone|}} esr → [https://drive.google.com/open?id=1Evqe-S6rvJCym9JW-vmjgcr-jc8fcQM-Gv56xaVGnLw report]<br />
<br />
==== Issues ====<br />
* '''New''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote><br />
* '''Known''':<br />
<blockquote><bugzilla><br />
{<br />
"id":"508606, 558178, 839074, 1037792, 1089326, 1144124, 1194214, 1195053, 1210769, 1230678, 1282075, 1300525, 1305744, 1309534, 1370743, 1393460, 1427280, 1430114, 1436015, 1458470, 1458471, 1470154, 1510235, 1521769, 1525243, 1529882, 1535539, 1541345, 1541376, 1563709, 1563715, 1563758, 1566795, 1572857",<br />
"include_fields":"id,summary,status,resolution,keywords"<br />
}<br />
</bugzilla></blockquote></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_70/Test_Plan&diff=1219083
Releases/Firefox 70/Test Plan
2019-10-15T15:49:39Z
<p>Bogdan.maris: /* Release 70 milestones */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 69 are available [https://docs.google.com/spreadsheets/d/10iNQQ2tmr0FP49bqmAi66-4qhSjKiW5e6wNQ47E-P9A/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 71 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1554912, 1555113<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1360545%2C%201354992%2C%201544509%2C%201370743%2C%201554597%2C%201554720%2C%201541376%2C%201430114%2C%201554912%2C%201515289%2C%201393460%2C%201525585%2C%201441881%2C%201443511%2C%201525607%2C%201194214%2C%201282075%2C%201512611%2C%201396732%2C%201555113%2C%201458885%2C%201144124%2C%201037792%2C%20839074%2C%201395520&bug_id_type=anyexact&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766805 bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1558762<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201393460%2C%201282075%2C%201194214%2C%201539182%2C%201525585%2C%201551534%2C%201528958%2C%201198363%2C%201511869%2C%201441881%2C%201443511%2C%201512611%2C%201536449%2C%201555834%2C%201354992%2C%201545115%2C%201460873%2C%201224550%2C%201364669%2C%201418954%2C%201503269%2C%201273604%2C%201525607%2C%201558762%2C%201396732%2C%201544701%2C%201210769%2C%201427280%2C%201370743%2C%201558753%2C%201544509%2C%201558762&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766809 bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 70 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2c2cb0df9517 2c2cb0df9517], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20010 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mblocked|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b2-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/04d54c74a744 04d54c74a744], 20190830040415) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20206 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{done|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6 1021b3e283c6], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20448 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b5 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b5 update tests)<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086 48e74f990086], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20876 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b9 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b9 update tests)<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/82e9cab54ba65854416b316306a31f045bdb2321 82e9cab54ba65854416b316306a31f045bdb2321], 20190902191027) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b4-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e 5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e], 20190905174512) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Images''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/16e8HATyYUnDO_qy8uMnGJHM0xoYdhs9P3Q-naopGj5M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6eb34514b46ad600c42a647ad85a8 1021b3e283c6eb34514b46ad600c42a647ad85a8], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''WebExtensions''', '''Scrolling, Panning and Zooming''' and '''Geolocation ''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20404 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20428 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/bb9376d19d79 bb9376d19d79], 20190912160217) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''' and '''Password Manager & Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20572 TestRail]<br />
*** {{done|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1995 TestRail]<br />
*** {{done|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2771f6fe4899 2771f6fe4899], 20190916074538) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20668 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20675 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/45c0e8a9df93f545bfacf07e5a78bd69559c6adf 45c0e8a9df93f545bfacf07e5a78bd69559c6adf], 20190919164641) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Downloads''', '''Installer''' and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20745]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20761 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086920697ec7b6d3a6ff95554de390f 48e74f990086920697ec7b6d3a6ff95554de390f], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Password Manager''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20859 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20848 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa 6f62baa8eaaa], 20190926005616) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' and '''Anti-Tracking''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20926 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20939 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa e8e31000eab2], 20190930132843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21027 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b12</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/24de1dfb6086 24de1dfb6086], 20191002212950) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''OS Integration''', '''Data migration''' and '''History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21125 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b13</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b13-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5757a036a4e8146e29b6eb487d708c9c40fcb36c], 20191007220302) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''PDF Viewer''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21237 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21172 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Uh9eO9IBoQyozTN2umvvslps7zjOQyfybxRJkp2dvWA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1naMRDRVlrj5--LTKKHw8bHYWqlyYogCgFlez7CYGV2o/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b14</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b14-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d7ecb0646db 5d7ecb0646db], 20191010142853) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Session Restore''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21356 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21367 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
== Release 70 milestones ==<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/0eae18af659f 0eae18af659f], 20191014163058) - Sign off_Status<br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2090 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → report<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → report<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1585499%201586216&list_id=14941422 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_70/Test_Plan&diff=1219082
Releases/Firefox 70/Test Plan
2019-10-15T15:49:25Z
<p>Bogdan.maris: /* Release 70 milestones */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 69 are available [https://docs.google.com/spreadsheets/d/10iNQQ2tmr0FP49bqmAi66-4qhSjKiW5e6wNQ47E-P9A/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 71 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1554912, 1555113<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1360545%2C%201354992%2C%201544509%2C%201370743%2C%201554597%2C%201554720%2C%201541376%2C%201430114%2C%201554912%2C%201515289%2C%201393460%2C%201525585%2C%201441881%2C%201443511%2C%201525607%2C%201194214%2C%201282075%2C%201512611%2C%201396732%2C%201555113%2C%201458885%2C%201144124%2C%201037792%2C%20839074%2C%201395520&bug_id_type=anyexact&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766805 bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1558762<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201393460%2C%201282075%2C%201194214%2C%201539182%2C%201525585%2C%201551534%2C%201528958%2C%201198363%2C%201511869%2C%201441881%2C%201443511%2C%201512611%2C%201536449%2C%201555834%2C%201354992%2C%201545115%2C%201460873%2C%201224550%2C%201364669%2C%201418954%2C%201503269%2C%201273604%2C%201525607%2C%201558762%2C%201396732%2C%201544701%2C%201210769%2C%201427280%2C%201370743%2C%201558753%2C%201544509%2C%201558762&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766809 bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 70 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2c2cb0df9517 2c2cb0df9517], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20010 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mblocked|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b2-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/04d54c74a744 04d54c74a744], 20190830040415) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20206 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{done|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6 1021b3e283c6], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20448 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b5 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b5 update tests)<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086 48e74f990086], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20876 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b9 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b9 update tests)<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/82e9cab54ba65854416b316306a31f045bdb2321 82e9cab54ba65854416b316306a31f045bdb2321], 20190902191027) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b4-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e 5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e], 20190905174512) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Images''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/16e8HATyYUnDO_qy8uMnGJHM0xoYdhs9P3Q-naopGj5M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6eb34514b46ad600c42a647ad85a8 1021b3e283c6eb34514b46ad600c42a647ad85a8], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''WebExtensions''', '''Scrolling, Panning and Zooming''' and '''Geolocation ''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20404 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20428 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/bb9376d19d79 bb9376d19d79], 20190912160217) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''' and '''Password Manager & Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20572 TestRail]<br />
*** {{done|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1995 TestRail]<br />
*** {{done|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2771f6fe4899 2771f6fe4899], 20190916074538) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20668 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20675 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/45c0e8a9df93f545bfacf07e5a78bd69559c6adf 45c0e8a9df93f545bfacf07e5a78bd69559c6adf], 20190919164641) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Downloads''', '''Installer''' and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20745]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20761 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086920697ec7b6d3a6ff95554de390f 48e74f990086920697ec7b6d3a6ff95554de390f], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Password Manager''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20859 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20848 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa 6f62baa8eaaa], 20190926005616) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' and '''Anti-Tracking''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20926 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20939 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa e8e31000eab2], 20190930132843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21027 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b12</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/24de1dfb6086 24de1dfb6086], 20191002212950) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''OS Integration''', '''Data migration''' and '''History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21125 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b13</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b13-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5757a036a4e8146e29b6eb487d708c9c40fcb36c], 20191007220302) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''PDF Viewer''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21237 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21172 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Uh9eO9IBoQyozTN2umvvslps7zjOQyfybxRJkp2dvWA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1naMRDRVlrj5--LTKKHw8bHYWqlyYogCgFlez7CYGV2o/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b14</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b14-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d7ecb0646db 5d7ecb0646db], 20191010142853) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Session Restore''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21356 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21367 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
== Release 70 milestones ==<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/0eae18af659f 0eae18af659f], 20191014163058) - Sign off_Status<br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2090 Status Report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → report<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → report<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1585499%201586216&list_id=14941422 Bug Verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → [https://docs.google.com/spreadsheets/d/1Qy_3XM0X2BD6i4pDc5U-nDKgDzdnDJzGhGaJFZVVWA0/edit#gid=850719639 report]<br />
*** {{mndone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/d/1Eo4OfeydNmJaWMyTVK_0ODyI4bku1L5rrtXpK_3XC0c/edit#gid=850719639 report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_71/Test_Plan&diff=1219076
Releases/Firefox 71/Test Plan
2019-10-15T14:28:03Z
<p>Bogdan.maris: Created page with "= Summary = The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed. == Release schedule == * [https://calendar.goo..."</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 71 are available [https://docs.google.com/spreadsheets/u/1/d/1aRRjQiFo4jT3fr1dJ-ZDsYa8SrQ9PzYbUCojataMFls/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 72 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 72.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: --<br />
**** Non-regressions: --<br />
*** Known bugs<br />
**** High-impact: --<br />
**** Low/medium-impact: [link bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 72.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 71 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2c2cb0df9517 2c2cb0df9517], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20010 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mblocked|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b2-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/04d54c74a744 04d54c74a744], 20190830040415) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20206 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{done|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/-- --], --) - <font style="color:grey; font-weight:bold;">NOT STARTED</font><br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [link TestRail]<br />
*** {{mnotstarted|}} Smoke testing on Ubuntu snap package → [link TestRail]<br />
*** {{mnotstarted|}} Smoke testing on DLL interceptor → [link Test Results]<br />
*** {{mnotstarted|}} Bug fix verification – [link Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} beta-cdntest, aurora-cdntest → [link report]<br />
*** {{mnotstarted|}} beta, aurora → [link report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_70/Test_Plan&diff=1218923
Releases/Firefox 70/Test Plan
2019-10-11T14:21:28Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 69 are available [https://docs.google.com/spreadsheets/d/10iNQQ2tmr0FP49bqmAi66-4qhSjKiW5e6wNQ47E-P9A/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 71 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1554912, 1555113<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1360545%2C%201354992%2C%201544509%2C%201370743%2C%201554597%2C%201554720%2C%201541376%2C%201430114%2C%201554912%2C%201515289%2C%201393460%2C%201525585%2C%201441881%2C%201443511%2C%201525607%2C%201194214%2C%201282075%2C%201512611%2C%201396732%2C%201555113%2C%201458885%2C%201144124%2C%201037792%2C%20839074%2C%201395520&bug_id_type=anyexact&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766805 bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1558762<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201393460%2C%201282075%2C%201194214%2C%201539182%2C%201525585%2C%201551534%2C%201528958%2C%201198363%2C%201511869%2C%201441881%2C%201443511%2C%201512611%2C%201536449%2C%201555834%2C%201354992%2C%201545115%2C%201460873%2C%201224550%2C%201364669%2C%201418954%2C%201503269%2C%201273604%2C%201525607%2C%201558762%2C%201396732%2C%201544701%2C%201210769%2C%201427280%2C%201370743%2C%201558753%2C%201544509%2C%201558762&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766809 bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 70 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2c2cb0df9517 2c2cb0df9517], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20010 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mblocked|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b2-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/04d54c74a744 04d54c74a744], 20190830040415) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20206 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{done|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6 1021b3e283c6], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20448 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b5 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b5 update tests)<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086 48e74f990086], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20876 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b9 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b9 update tests)<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/82e9cab54ba65854416b316306a31f045bdb2321 82e9cab54ba65854416b316306a31f045bdb2321], 20190902191027) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b4-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e 5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e], 20190905174512) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Images''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/16e8HATyYUnDO_qy8uMnGJHM0xoYdhs9P3Q-naopGj5M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6eb34514b46ad600c42a647ad85a8 1021b3e283c6eb34514b46ad600c42a647ad85a8], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''WebExtensions''', '''Scrolling, Panning and Zooming''' and '''Geolocation ''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20404 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20428 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/bb9376d19d79 bb9376d19d79], 20190912160217) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''' and '''Password Manager & Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20572 TestRail]<br />
*** {{done|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1995 TestRail]<br />
*** {{done|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2771f6fe4899 2771f6fe4899], 20190916074538) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20668 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20675 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/45c0e8a9df93f545bfacf07e5a78bd69559c6adf 45c0e8a9df93f545bfacf07e5a78bd69559c6adf], 20190919164641) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Downloads''', '''Installer''' and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20745]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20761 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086920697ec7b6d3a6ff95554de390f 48e74f990086920697ec7b6d3a6ff95554de390f], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Password Manager''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20859 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20848 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa 6f62baa8eaaa], 20190926005616) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' and '''Anti-Tracking''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20926 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20939 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa e8e31000eab2], 20190930132843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21027 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b12</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/24de1dfb6086 24de1dfb6086], 20191002212950) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''OS Integration''', '''Data migration''' and '''History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21125 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b13</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b13-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5757a036a4e8146e29b6eb487d708c9c40fcb36c], 20191007220302) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''PDF Viewer''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21237 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21172 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Uh9eO9IBoQyozTN2umvvslps7zjOQyfybxRJkp2dvWA/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1naMRDRVlrj5--LTKKHw8bHYWqlyYogCgFlez7CYGV2o/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b14</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b14-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5d7ecb0646db 5d7ecb0646db], 20191010142853) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Session Restore''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21356 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/21367 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1794AYicCMssPvvAEJ56Op5i4IVcCTcZ-C6yd5jSUZlQ/edit#gid=850719639 report]<br />
</div></div><br />
<br />
== Release 70 milestones ==<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build1 (commit, ID) - Sign off_Status<br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on _ → report<br />
*** {{mnotstarted|}} Smoke testing on Ubuntu snap package → report<br />
*** {{mnotstarted|}} Smoke testing on Windows Acer builds → report<br />
*** {{mnotstarted|}} Bug fix verification – <bug list><br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} beta-cdntest → report<br />
*** {{mnotstarted|}} beta → report<br />
*** {{mnotstarted|}} release-localtest → report<br />
*** {{mnotstarted|}} release-cdntest → report<br />
*** {{mnotstarted|}} release → report<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_69/Test_Plan&diff=1218887
Releases/Firefox 69/Test Plan
2019-10-10T13:56:23Z
<p>Bogdan.maris: /* Release 69 milestones */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 69 are available [https://docs.google.com/spreadsheets/d/10iNQQ2tmr0FP49bqmAi66-4qhSjKiW5e6wNQ47E-P9A/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 69 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1554912, 1555113<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1360545%2C%201354992%2C%201544509%2C%201370743%2C%201554597%2C%201554720%2C%201541376%2C%201430114%2C%201554912%2C%201515289%2C%201393460%2C%201525585%2C%201441881%2C%201443511%2C%201525607%2C%201194214%2C%201282075%2C%201512611%2C%201396732%2C%201555113%2C%201458885%2C%201144124%2C%201037792%2C%20839074%2C%201395520&bug_id_type=anyexact&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766805 bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1558762<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201393460%2C%201282075%2C%201194214%2C%201539182%2C%201525585%2C%201551534%2C%201528958%2C%201198363%2C%201511869%2C%201441881%2C%201443511%2C%201512611%2C%201536449%2C%201555834%2C%201354992%2C%201545115%2C%201460873%2C%201224550%2C%201364669%2C%201418954%2C%201503269%2C%201273604%2C%201525607%2C%201558762%2C%201396732%2C%201544701%2C%201210769%2C%201427280%2C%201370743%2C%201558753%2C%201544509%2C%201558762&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766809 bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 69 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 69.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/625005a94d4 625005a94d4], 20190701201355) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics compatibility & support''' and '''Media''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/18600 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 69.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/88e401857465 88e401857465], 20190704152356 ) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Download Manager''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/18752 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} aurora-cdntest → [https://drive.google.com/open?id=1vNEKP0Uf3X9Fpjc9o8PCw1DIUk4wgk2drKaDSLRCSYc Report]<br />
*** {{mnotstarted|}} aurora → [https://drive.google.com/open?id=1vNEKP0Uf3X9Fpjc9o8PCw1DIUk4wgk2drKaDSLRCSYc Report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 69.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0b5-build1 ([], ) - Sign off_Status<br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Developer Edition Recurring Sign off → [TestRail]<br />
*** {{mnotstarted|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 69.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0b9-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/7a6223dba05a 7a6223dba05a], 20190730004747) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/19413 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 69.0b9 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 69.0b9 update tests)<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 69.0b13</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0b13-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8ecc148a2fad 8ecc148a2fad], 20190812173625) - <font style="color:black; font-weight:bold;">IN PROGRESS</font><br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/19718 TestRail]<br />
*** {{mprog|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} aurora-cdntest (as part of Beta 69.0b9 update tests)<br />
*** {{mnotstarted|}} aurora (as part of Beta 69.0b9 update tests)<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 69.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/9cdcc170dc1a 9cdcc170dc1a], 20190708182549) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Search''' and '''Awesomebar & indicators''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1836 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1834 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/document/d/1tq_h4FAR05tWRjFAAPHGnrQcOFq2IpPBKmq6syBZ5jQ/edit report]<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/document/d/1tq_h4FAR05tWRjFAAPHGnrQcOFq2IpPBKmq6syBZ5jQ/edit report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b4</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b4-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a7b97568af69 a7b97568af69], 20190712011116) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Media playback & support''' and '''Profile support & compatibility''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1840 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1841 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/19sKMUD3iqX2QlJzyoALsnIhXTL7jeMSzmy4fvS0MgXM/edit#gid=850719639 report]<br />
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/19sKMUD3iqX2QlJzyoALsnIhXTL7jeMSzmy4fvS0MgXM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b5</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/e5d98eda2ec3 e5d98eda2ec3], 20190715173502) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''WebExtensions compatibility & support''' and '''Content scroll, zoom & drag support''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/18973 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/18987 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://drive.google.com/open?id=1mKS5ROHpD-L8VDLPDJUGAhxq_unLFU6y3saQY4ynXfg report]<br />
*** {{mnotstarted|}} beta, aurora → [https://drive.google.com/open?id=1mKS5ROHpD-L8VDLPDJUGAhxq_unLFU6y3saQY4ynXfg report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b6</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/df88785f07c8 df88785f07c8], 20190718172058) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''', '''Crash''' and '''Build installation & uninstallation''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1860 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1861 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1dBJ4PeqEIIoeMOg45F716VSjKKXr6otaY-sP2esQLXY/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b7</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/f8413df45c55 f8413df45c55], 20190722201635) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', ''Safe browsing''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1866 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1864 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1QZsxezEf1rxtj9f5FfkFyHHkF5bMOhmnGhOpOMPb0Xk/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b8</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/53bb71da50e5 53bb71da50e5], 20190722201635) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Default & custom theme support''' and '''Image compatibility & support''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1871 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1870 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1ILPo_YYcyCSwlol0NgFnfohfNM7Sj0oT7xZx2UgiQDM/edit#gid=1820957350 report]<br />
*** {{mdone|}} beta, aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b9</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b9-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/7a6223dba05a12ea56460010c7ecd878399855a6 7a6223dba05a],20190730004747 ) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Crash Reporting ''', '''Graphics compatibility & support''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1879 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [report]<br />
*** {{mprog|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1567614%2C%201562821%2C%201567095%2C%201565996%2C%201566540%2C%201565485%2C%201564818%2C%201559717%2C%201502821%2C%201565980%2C%201559216%2C%201566783%2C%201565158%2C%201565848%2C%201568108%2C%201553818%2C%201568841%2C%201563914%2C%201567419&list_id=14828120 17]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} beta-cdntest, aurora-cdntest → report]<br />
*** {{mnotstarted|}} beta, aurora → report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b10</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2fc476538438ee9ae515aedce64807bd104fab2f 2fc476538438], 20190801185445) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''In-browser PDF support''' and '''Anti-Tracking-Privacy''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1893 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/19483 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1VUk4z2etiAmE8IPWPw_9_XtX9_P0aHP2nnNSBGNjNQA/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b11</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b11-build1 ([], ) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19518]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1897]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/15zGbclq-2mK4Ew1q7LXiDszshq3yeg7mWV6GWYsWrOw/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15zGbclq-2mK4Ew1q7LXiDszshq3yeg7mWV6GWYsWrOw/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b12</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8055f364e2cc60f0f721ec2694f684b715a2c037 8055f364e2cc], 20190807220259) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''', '''Adress Bar''' and '''Smart Card''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/1913 TestRail] <br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1912 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/15RoLcoXy758E8a8HlVfMNPwwsrWyJ6T7W6IvZ7UUzEU/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15RoLcoXy758E8a8HlVfMNPwwsrWyJ6T7W6IvZ7UUzEU/edit?usp=sharing report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b13</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b13-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8ecc148a2fad 8ecc148a2fad], 20190812173625) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''' and '''Bookmarks and History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19691 TestRail] <br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1915 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/15C7uQXB6re70_sAAkmrfHy1R_woxbjap4WwE14WCTSU/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/15C7uQXB6re70_sAAkmrfHy1R_woxbjap4WwE14WCTSU/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b14</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b14-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/: 3a3ff2f2324c 3a3ff2f2324c], 20190815163925) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Search''' and '''Data Migration''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19828 TestRail] <br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/19854 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1lJZo6b_Sp13JKYay_oD6pZVAyT2wAXGk700TcUYiI0Y/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1lJZo6b_Sp13JKYay_oD6pZVAyT2wAXGk700TcUYiI0Y/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b15</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b15-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/66a12ddcf77c 66a12ddcf77c], 20190819184224) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''', '''WebExtensions''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19885 TestRail] <br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/19911 report]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Cl9lk_yaZTAgkwlg4gqDYFtpS2aef8zzGra3Gh0lmuw/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Cl9lk_yaZTAgkwlg4gqDYFtpS2aef8zzGra3Gh0lmuw/edit#gid=850719639 report]<br />
</div></div> <br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 69.0b16</div><br />
<div class="mw-collapsible-content"><br />
<br />
* Build: 69.0b16-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/91c666707c219c5215117da97cbbec3bf07f42e1 91c666707c21], 20190822210915) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mprog|}} Smoke, Regression and Exploratory testing on '''Password Manager & Form Autofill''' and '''Startup and Profile''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/19962] <br />
*** {{mprog|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/19911 report]<br />
*** {{mprog|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug List]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Cl9lk_yaZTAgkwlg4gqDYFtpS2aef8zzGra3Gh0lmuw/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Cl9lk_yaZTAgkwlg4gqDYFtpS2aef8zzGra3Gh0lmuw/edit#gid=850719639 report]<br />
</div></div><br />
<br />
== Release 69 milestones ==<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 69.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0-build2 ([https://hg.mozilla.org/releases/mozilla-release/rev/cce4622026ab8e0130a0afc03f829f9b19ca38c2 9f9b19ca38c2], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on _ → [https://testrail.stage.mozaws.net/index.php?/plans/view/20004 report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20104 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1MeF9I76qp94Bu8NwPuGoRWfzgewJg5mOfhCucKqKrOE/edit report]<br />
*** {{mprog|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest → [https://docs.google.com/spreadsheets/d/16nH7Qo0lGw7s6C_Z1GwReojOj99-x6YBvOf7_OgwrdY/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta → report<br />
*** {{mdone|}} release-localtest → [https://docs.google.com/spreadsheets/d/1ekp9cni0mM52BWr5FaQthfhpPn7682YzKa8Q3lXOy4A/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} release-cdntest → report<br />
*** {{mnotstarted|}} release → report<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC 69.0.1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/bf6ea738ba07 bf6ea738ba07], 20190917135527) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20716 report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20733 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1kemnj1nSUBIInf_AOhoKfGq2Xo_CEEA5eO9CcZcTwlw/edit#heading=h.ra59jc33u21r report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1567600%2C%201578075%2C%201578136%2C%201578454%2C%201578633%2C%201580506%2C%201570845%2C%201576372%2C%201577324%2C%201578354%2C%201580416%2C%201581160&list_id=14900769 Bug verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1CJKBZpVmmelzpUxhfv1wNPzP-fddwWGCS2BuvFNMVFY/edit?usp=drive_web&ouid=102568952189939481948 report]<br />
*** {{mnotstarted|}} release → [https://docs.google.com/spreadsheets/u/1/d/1CJKBZpVmmelzpUxhfv1wNPzP-fddwWGCS2BuvFNMVFY/edit?usp=drive_web&ouid=102568952189939481948 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC 69.0.2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0.2-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/e40b66e55c28 e40b66e55c28], 20191001234643) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' & '''Telemetry''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2047 report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2043 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1mfJ7r-K5ez9Jz_AqakEXXThmTl-3xm-lF22mdJqkEnk/edit# report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1583368%2C1582222%2C1579858%2C1584613%2C1582726%2C1583225%2C1562686 Bug verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1s3ncylyl8y9u_vH1VauTdj7zABRFRX4fLL9Hg2wC8xw/edit#gid=850719639 report]<br />
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/d/1s3ncylyl8y9u_vH1VauTdj7zABRFRX4fLL9Hg2wC8xw/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC 69.0.3</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0.3-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/c4227f95dae9 c4227f95dae9], 20191009172106) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Web Compatibility''' & '''Telemetry''' → [https://testrail.stage.mozaws.net/index.php?/reports/view/2080 report]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2043 report]<br />
*** {{mdone|}} Smoke testing on Windows Acer builds → [https://docs.google.com/document/d/1fKG91Lf1UHh2TL23w2czUvJSdtjlwRD0Gac0DCe6D0A/edit# report]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1586228%201586354&list_id=14934669 Bug verification]<br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} release-cdntest → [link report]<br />
*** {{mnotstarted|}} release → [link report]<br />
</div></div></div>
Bogdan.maris
https://wiki.mozilla.org/index.php?title=Releases/Firefox_70/Test_Plan&diff=1218597
Releases/Firefox 70/Test Plan
2019-10-04T14:23:02Z
<p>Bogdan.maris: /* Beta build readiness */</p>
<hr />
<div>= Summary =<br />
The purpose of this page is to track the testing of Firefox 69 from Nightly to Release, and post Release if needed.<br />
<br />
== Release schedule ==<br />
* [https://calendar.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Scheduling] calendar<br />
* [https://wiki.mozilla.org/RapidRelease/Calendar Rapid Release] calendar<br />
<br />
== Status meetings ==<br />
The [https://wiki.mozilla.org/Firefox/Channels/Meetings Channel Status] meeting is used to raise quality concerns with the Release Management team.<br />
<br />
* '''When''': every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)<br />
* '''Where''': [https://mozilla.zoom.us/j/266532573 ReleaseCoordination] (Zoom)<br />
* '''IRC backchannel''': [irc://irc.mozilla.org/planning #planning]<br />
* '''Meeting notes''': [https://wiki.mozilla.org/Firefox/Channels/Meetings notes archive]<br />
<br />
== QA points of contact ==<br />
<br />
=== Communication channels ===<br />
* '''Slack''': [https://mozilla.slack.com/messages/CAC9YSH3P #qa-coordination]<br />
<br />
=== Firefox for Desktop ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Engineering QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/btot@mozilla.com Brindusa Tot]<br />
* '''Offices''': Romania (EEST), Argentina (GMT-3)<br />
* '''Responsible for''': new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/tgrabowski@mozilla.com Tom Grabowski], [https://phonebook.mozilla.org/tree.php?search/tmaity@mozilla.com Tania Maity]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/avaida@mozilla.com Andrei Vaida]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/bmaris@mozilla.com Bogdan Maris], [https://phonebook.mozilla.org/tree.php?search/cionce@mozilla.com Cornel Ionce]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation<br />
</div></div><br />
<br />
=== Firefox for Mobile ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Release QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/sflorean@mozilla.com Sorina Florean]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Firefox for iOS QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/njpark@mozilla.com No-Jun Park]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/ichiorean@mozilla.com Ioana Chiorean]<br />
* '''Team Lead''': [https://phonebook.mozilla.org/tree.php?search/csuciu@mozilla.com Catalin Suciu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': <mark>todo</mark><br />
</div></div><br />
<br />
=== AMO, WebExtensions ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Add-ons QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/vcarciu@mozilla.com Victor Carciu], [https://phonebook.mozilla.org/tree.php?search/mcotetiu@mozilla.com Madalin Cotetiu]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry<br />
</div></div><br />
<br />
=== Experiments, Normandy, Subscription services, and other Firefox features ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Experiments QA</div><br />
<div class="mw-collapsible-content"><br />
* '''Reporting to''': [https://phonebook.mozilla.org/tree.php?search/kraj@mozilla.com Krupa Raj]<br />
* '''Softvision Manager''': [https://phonebook.mozilla.org/tree.php?search/rbologa@mozilla.com Rares Bologa]<br />
* '''Team Leads''': [https://phonebook.mozilla.org/tree.php?search/poiegas@mozilla.com Paul Oiegas]<br />
* '''Office''': Romania (EEST)<br />
* '''Responsible for''': testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop. <br />
</div></div><br />
<br />
== QA activities ==<br />
=== New feature readiness ===<br />
All new features tested by QA and shipping with Firefox 69 are available [https://docs.google.com/spreadsheets/d/10iNQQ2tmr0FP49bqmAi66-4qhSjKiW5e6wNQ47E-P9A/edit#gid=0 here].<br />
<br />
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here].<br />
<br />
=== Bug fix verification ===<br />
* '''Daily verification of uplifted bugs''' - these are uplifts, triaged daily and verified under ~48hrs<br />
* '''Ongoing verification of Nightly bugs''' - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''Ongoing verification of Beta bugs''' - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of <code>qe-verify?</code> bugs<br />
* '''On-demand verification of bugs''' - these are special requests (ideally coming in through PI, but also through Bugzilla <code>needinfo?</code>, chat or emails)<br />
* '''Periodical verification of security bugs''' - these are ''post-critsmash'' bugs, triaged and verified ~every 2wks<br />
<br />
=== Unconfirmed bug triage ===<br />
This is the triage conducted by Engineering QA.<br />
<br />
=== Security bug triage ===<br />
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).<br />
<br />
=== Bug investigation ===<br />
This is the daily check and investigation of new <code>regressionwindow-wanted</code> bugs, conducted by Engineering QA and Release QA.<br />
<br />
== Nightly 71 milestones ==<br />
=== [early/mid cycle] Nightly build readiness ===<br />
<br />
'''Scope''': assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge ([https://docs.google.com/document/d/1etTi-uvpAlaoAoErcHcJVvd9-QIcdn7uH-WCzu72T3Y/edit more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-05-30)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17705 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1554912, 1555113<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1360545%2C%201354992%2C%201544509%2C%201370743%2C%201554597%2C%201554720%2C%201541376%2C%201430114%2C%201554912%2C%201515289%2C%201393460%2C%201525585%2C%201441881%2C%201443511%2C%201525607%2C%201194214%2C%201282075%2C%201512611%2C%201396732%2C%201555113%2C%201458885%2C%201144124%2C%201037792%2C%20839074%2C%201395520&bug_id_type=anyexact&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766805 bug list]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (2019-06-13)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** {{mdone|}} Functional testing (manual) → [https://testrail.stage.mozaws.net/index.php?/plans/view/17978 report]<br />
*** New bugs<br />
**** Regressions: none<br />
**** Non-regressions: 1558762<br />
*** Known bugs<br />
**** High-impact: none<br />
**** Low/medium-impact: [https://bugzilla.mozilla.org/buglist.cgi?bug_id=1515289%2C%201393460%2C%201282075%2C%201194214%2C%201539182%2C%201525585%2C%201551534%2C%201528958%2C%201198363%2C%201511869%2C%201441881%2C%201443511%2C%201512611%2C%201536449%2C%201555834%2C%201354992%2C%201545115%2C%201460873%2C%201224550%2C%201364669%2C%201418954%2C%201503269%2C%201273604%2C%201525607%2C%201558762%2C%201396732%2C%201544701%2C%201210769%2C%201427280%2C%201370743%2C%201558753%2C%201544509%2C%201558762&bug_id_type=anyexact&resolution=---&classification=Client%20Software&classification=Developer%20Infrastructure&classification=Components&classification=Server%20Software&classification=Other&query_format=advanced&list_id=14766809 bug list]<br />
</div></div><br />
<br />
=== [prior to merge] Nightly regression testing ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Nightly 69.0a1 (date)</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 69.0a1 (commit, ID) - Sign off_Status<br />
** {{mnotstarted|}} Regression testing (manual) → [report]<br />
*** New bugs<br />
**** Regressions: ID1, ID2, IDn<br />
**** Non-regressions: ID1, ID2, IDn<br />
*** Known bugs<br />
**** High-impact: ID1, ID2, IDn<br />
**** Low/medium-impact: [bug list]<br />
</div></div><br />
<br />
=== [optional] [prior to merge] Nightly new feature smoke testing ===<br />
'''Note''': this is optional, based on available QA bandwidth.<br />
<br />
== Beta/DevEd 70 milestones ==<br />
=== Developer Edition build readiness ===<br />
'''Scope''': assess build stability periodically (around every 2 weeks) to make sure we are shipping quality products to our Developer Edition users from the aurora update channel ([https://docs.google.com/document/d/1BsZ7QTzomPKBgRRYLnTcuAcrJM7BOcK2SgMtIoVlWNY/edit# more on this]).<br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b1</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b1-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2c2cb0df9517 2c2cb0df9517], 20190827005903) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Session Restore''' and '''Printing''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20010 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mblocked|}} aurora-cdntest → [report]<br />
*** {{mnotstarted|}} aurora → [report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b2</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b2-build2 ([https://hg.mozilla.org/releases/mozilla-beta/rev/04d54c74a744 04d54c74a744], 20190830040415) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Graphics''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20206 TestRail]<br />
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=195714110 Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{done|}} aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} aurora → [https://docs.google.com/spreadsheets/d/1JO7RM3Gf58yY4K0GRqkJOZfp3ulLmFSdCU8bsgNtow0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6 1021b3e283c6], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20448 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b5 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b5 update tests)<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">DevEd 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086 48e74f990086], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Developer Edition Recurring Sign off → [https://testrail.stage.mozaws.net/index.php?/plans/view/20876 TestRail]<br />
*** {{mdone|}} [Bug fix verification]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} aurora-cdntest (as part of Beta 70.0b9 update tests)<br />
*** {{mdone|}} aurora (as part of Beta 70.0b9 update tests)<br />
</div></div><br />
<br />
=== Beta build readiness ===<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b3</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b3-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/82e9cab54ba65854416b316306a31f045bdb2321 82e9cab54ba65854416b316306a31f045bdb2321], 20190902191027) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Plug-ins''', '''Address Bar''' and '''Crash Reporting''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Smoke testing on DLL interceptor → [https://docs.google.com/document/d/1To6OY_hzDaEsOQkR_9VZN9S3dUZkQq_HRQJXLvHaPgQ/edit Test Results]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b4</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b4-build3 ([https://hg.mozilla.org/releases/mozilla-beta/rev/5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e 5da3c0a0771e9c2ff102bfc5d97d9bb5bb93788e], 20190905174512) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Images''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20256 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20280 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/16e8HATyYUnDO_qy8uMnGJHM0xoYdhs9P3Q-naopGj5M/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1oNaL7ByqwAmHnLuz3MrWBUE7SxKuYPjWVuZWD8pW6Yo/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b5</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1021b3e283c6eb34514b46ad600c42a647ad85a8 1021b3e283c6eb34514b46ad600c42a647ad85a8], 20190909162732) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''WebExtensions''', '''Scrolling, Panning and Zooming''' and '''Geolocation ''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20404 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20428 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aU2GWJO9MmubUmzHwMKcTse206x_7RhAFnZspqCVtcM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b6</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/bb9376d19d79 bb9376d19d79], 20190912160217) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Safe Browsing''' and '''Password Manager & Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20572 TestRail]<br />
*** {{done|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/1995 TestRail]<br />
*** {{done|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/165etqoA2ljJFtScAbusHzRLao5kXfarv282qrNkg-uM/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b7</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/2771f6fe4899 2771f6fe4899], 20190916074538) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Address Bar''' and '''Audio/Video''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20668 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20675 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/11tQHnVLxSZX8YHMoTIggM9qZk6-edcNFq9cFaGpalgg/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b8</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/45c0e8a9df93f545bfacf07e5a78bd69559c6adf 45c0e8a9df93f545bfacf07e5a78bd69559c6adf], 20190919164641) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Downloads''', '''Installer''' and '''Theme and Toolbar Customization''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20745]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20761 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=271991687 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1kEiAs09WIyYduALbLDt-Cf-rTTP98u7DwatMkng3Be0/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b9</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/48e74f990086920697ec7b6d3a6ff95554de390f 48e74f990086920697ec7b6d3a6ff95554de390f], 20190923154733) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Password Manager''' and '''Search''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20859 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20848 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1Viq5oOdYrrVjCloq2i-4gQzulEAatC0Yd090WLpDN5Q/edit#gid=850719639 report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b10</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa 6f62baa8eaaa], 20190926005616) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone||}} Smoke, Regression and Exploratory testing on '''Startup and Profile''' and '''Anti-Tracking''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/20926 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/plans/view/20939 TestRail]<br />
*** {{mprog|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b11</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/6f62baa8eaaa e8e31000eab2], 20190930132843) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''Graphics''' and '''Bookmarks''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21027 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&columnlist=bug_id%2Cshort_desc%2Cproduct%2Ccomponent%2Cbug_status%2Ccf_status_firefox69%2Ccf_status_firefox70%2Cflagtypes.name%2Cstatus_whiteboard%2Cpriority&f1=OP&f10=target_milestone&f11=bug_status&f12=CP&f14=CP&f15=flagtypes.name&f2=keywords&f3=status_whiteboard&f4=cf_qa_whiteboard&f5=flagtypes.name&f6=CP&f7=OP&f8=cf_status_firefox70&f9=OP&j1=OR&j7=OR&o10=substring&o11=equals&o15=notregexp&o2=substring&o3=substring&o4=substring&o5=substring&o8=equals&op_sys=Unspecified&op_sys=All&op_sys=Windows&op_sys=Windows%20NT&op_sys=Windows%20XP&op_sys=Windows%20Vista&op_sys=Windows%207&op_sys=Windows%208&op_sys=Windows%208.1&op_sys=Windows%2010&op_sys=Linux&op_sys=Other&product=Core&product=DevTools&product=Firefox&product=Toolkit&query_format=advanced&resolution=FIXED&short_desc=%5BhH%5Domescreen%7Cb2g%7CB2G%7Csms%7CSMS%7C%5BgG%5Daia%20&short_desc_type=notregexp&status_whiteboard=b2g%7CB2G&status_whiteboard_type=notregexp&v10=70&v11=Resolved&v15=approval-mozilla-beta%7Capproval-mozilla-release%7Capproval-mozilla-esr60%7Capproval-mozilla-esr68&v2=verifyme&v3=qa%2B&v4=qa%2B&v5=qe-verify%2B&v8=fixed&list_id=14913486 Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1JgEV-dlgUe6uEG28d7iThdoFDC6lQZKnHvg_R8Rc0bI/edit#gid=850719639 report]<br />
*** {{mnotstarted|}} beta, aurora → [ report]<br />
</div></div><br />
<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">Beta 70.0b12</div><br />
<div class="mw-collapsible-content"><br />
* Build: 70.0b12-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/24de1dfb6086 24de1dfb6086], 20191002212950) - <font style="color:green; font-weight:bold;">GREEN</font><br />
** '''Functional tests (manual)''':<br />
*** {{mdone|}} Smoke and Regression testing on '''OS Integration''', '''Data migration''' and '''History''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/21125 TestRail]<br />
*** {{mdone|}} Smoke testing on Ubuntu snap package → [https://testrail.stage.mozaws.net/index.php?/reports/view/2039 TestRail]<br />
*** {{mdone|}} Bug fix verification – [https://drive.google.com/open?id=12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA Bug list]<br />
** '''Update tests (manual)''':<br />
*** {{mdone|}} beta-cdntest, aurora-cdntest → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
*** {{mnotstarted|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1A7D_4B9RMfZnTqgdc01fA8p7G38WPkcpCXh6yujlFyk/edit?usp=sharing report]<br />
</div></div><br />
<br />
== Release 70 milestones ==<br />
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"><br />
<div style="font-weight:bold;line-height:1.6;">RC1 70.0</div><br />
<div class="mw-collapsible-content"><br />
* '''Build''': 70.0-build1 (commit, ID) - Sign off_Status<br />
** '''Functional tests (manual)''':<br />
*** {{mnotstarted|}} Smoke, Regression and Exploratory testing on _ → report<br />
*** {{mnotstarted|}} Smoke testing on Ubuntu snap package → report<br />
*** {{mnotstarted|}} Smoke testing on Windows Acer builds → report<br />
*** {{mnotstarted|}} Bug fix verification – <bug list><br />
** '''Update tests (manual)''':<br />
*** {{mnotstarted|}} beta-cdntest → report<br />
*** {{mnotstarted|}} beta → report<br />
*** {{mnotstarted|}} release-localtest → report<br />
*** {{mnotstarted|}} release-cdntest → report<br />
*** {{mnotstarted|}} release → report<br />
</div></div></div>
Bogdan.maris