Releases/Firefox 63/Test Plan: Difference between revisions

Jump to navigation Jump to search
m
Line 68: Line 68:
During the Beta cycle, there are several beta releases. Communication with the release coordination, release engineering, and automation teams is key.  
During the Beta cycle, there are several beta releases. Communication with the release coordination, release engineering, and automation teams is key.  


While Firefox 62 is on the Beta channel, QA will mainly focus on:
While Firefox 63 is on the Beta channel, QA will mainly focus on:
* Signing off each Beta build prior to being pushed to the beta channel - RelQA
* Signing off each Beta build prior to being pushed to the beta channel - RelQA
* [https://docs.google.com/document/d/1rxisBtzIVZwSAuIIzQ5WCAUUYL2ZhtUQ9xiSBBAOCKY/ Feature Testing] - RelQA team
* [https://docs.google.com/spreadsheets/d/1IdIMWOrYymTVKgCPiPoxWQ3xlYBNbGX_UC2rAX1YRYY/edit Feature Testing] - RelQA team
** Focus is on fixes that land in Beta, and Regression and Smoke testing
** Focus is on fixes that land in Beta, and Regression and Smoke testing
* Regular validation of DevEdition builds - about once every two weeks
* Regular validation of DevEdition builds - about once every two weeks
Line 76: Line 76:
* Bug Verification - mostly RelQA - with main focus on: fixes related to new features, fixes for major bugs, fixes assessed as high risk
* Bug Verification - mostly RelQA - with main focus on: fixes related to new features, fixes for major bugs, fixes assessed as high risk


QA also analyzes the results of [https://treeherder.mozilla.org/#/jobs?repo=mozilla-beta&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-beta OnDemand Update tests] running on [http://mm-ci-master.qa.scl3.mozilla.com:8080/ Jenkins]. We create config files for the update tests, check their validity, and run them on at least two channels for each beta release cycle.
QA also analyzes the results of update testing which is done manually at this stage. We run them on at least two channels for each beta release cycle.


Pivotal bugs may need verification during each beta cycle.
Pivotal bugs may need verification during each beta cycle.
Confirmed users
1,904

edits

Navigation menu