157
edits
QA/DevTools Go Faster: Difference between revisions
Jump to navigation
Jump to search
→Sign off
| Line 198: | Line 198: | ||
= Sign off = | = Sign off = | ||
== Criteria == | == Criteria == | ||
Checklist | |||
* All test cases should be executed | |||
* Has sufficient automated test coverage (as measured by code coverage tools) - coordinate with RelMan | |||
* All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA) | |||
== Results == | == Results == | ||
'''Nightly testing'''<br /> | |||
List of OSes that will be covered by testing<br /> | |||
*Link for the tests run | |||
** Full Test suite, link to TestRail - Tests Runs and Results [https://testrail.stage.mozaws.net/index.php?/runs/overview/17 link] | |||
** Daily Smoke, if needed/available | |||
** Regression Test suite, if needed/available | |||
<br /> | |||
'''Merge to Beta Sign-off'''<br /> | |||
List of OSes that will be covered by testing<br /> | |||
*Link for the tests run | |||
** Full Test suite | |||
== Checklist == | == Checklist == | ||
{| class="wikitable" style="width:60%" | |||
|- | |||
! Exit Criteria !! Status !! Notes/Details | |||
|- | |||
| Testing Prerequisites (specs, use cases) | |||
| style="text-align:center;" | | |||
| style="text-align:center;" | | |||
|- | |||
| Testing Infrastructure setup | |||
|style="text-align:center;" | || | |||
|- | |||
| Test Plan Creation | |||
| style="text-align:center;" | || | |||
|- | |||
| Test Cases Creation | |||
|style="text-align:center;" | || | |||
|- | |||
| Automation Coverage || | |||
|style="text-align:center;" | | |||
|- | |||
| Performance Testing | |||
|style="text-align:center;" | || | |||
|- | |||
| All Defects Logged || || | |||
|- | |||
| Critical/Blockers Fixed and Verified || || | |||
|- | |||
| Metrics/Telemetry|| | |||
|style="text-align:center;" | | |||
|- | |||
| Basic/Core functionality Nightly testing | |||
|style="text-align:center;" | | |||
|style="text-align:center;" | | |||
|- | |||
| QA mid-Nightly Signoff|| | |||
|style="text-align:center;" | Email to be sent | |||
|- | |||
| QA Nightly - Full Testing | |||
|style="text-align:center;" | || | |||
|- | |||
| QA pre-Beta Signoff|| | |||
|style="text-align:center;"| Email to be sent | |||
|- | |||
| QA Beta - Full Testing | |||
|style="text-align:center;" | || | |||
|- | |||
| QA pre-Release Signoff || | |||
|style="text-align:center;" | Email to be sent | |||
|} | |||