B2G/QA/Smoke Tests: Difference between revisions

→‎Smoke Tests: updated page sections
(→‎Smoke Tests by Functional Area: added Bugzilla queries)
(→‎Smoke Tests: updated page sections)
Line 32: Line 32:
* When a new build becomes available, QA verifies that the bug no longer reproduces.
* When a new build becomes available, QA verifies that the bug no longer reproduces.
* If the bug no longer reproduces, the bug requesting OTA to be reopened and a request is made to enable OTA again.
* If the bug no longer reproduces, the bug requesting OTA to be reopened and a request is made to enable OTA again.
= Smoke Test Blockers =
Bugzilla Query for the Whiteboard tag "smoketest": http://mzl.la/16lkWbM
== Escalation Strategy ==
* When a Smoke Test Blocker is found, it is reported in Bugzilla with the Whiteboard tag "smoketest".
* The QA Team is notified in the the #fxosqa IRC channel.
* A regression window for the root cause of the bug is identified.
* The developer who authored the commit is needinfo?ed with a request to back out the commit as soon as possible.
* The Whiteboard tag "[backout-needed]" is added to the bug.
* The [https://wiki.mozilla.org/Modules/FirefoxOS module owner] is also needinfo?ed.
* A Smoke Test report email is sent daily by the Firefox OS QA team to the following mailing lists: fxosqa-report-watchlist@mozilla.org and b2g-release-drivers@mozilla.org
* QA tracks the bug until the commit has been backed out.
* QA requests for a new nightly build to be created.
* When a new build becomes available, QA verifies that the bug no longer reproduces.
= Test Automation =
* Gaia UI Tests: https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests


= Smoke Tests by Functional Area =
= Smoke Tests by Functional Area =
Line 201: Line 219:
== Firefox Accounts ==
== Firefox Accounts ==
* [https://moztrap.mozilla.org/manage/case/13006/ 13006] Successful Sign up in Settings
* [https://moztrap.mozilla.org/manage/case/13006/ 13006] Successful Sign up in Settings
= Smoke Test Blockers =
Bugzilla Query for the Whiteboard tag "smoketest": http://mzl.la/16lkWbM
== Escalation Strategy ==
* When a Smoke Test Blocker is found, it is reported in Bugzilla with the Whiteboard tag "smoketest".
* The QA Team is notified in the the #fxosqa IRC channel.
* A regression window for the root cause of the bug is identified.
* The developer who authored the commit is needinfo?ed with a request to back out the commit as soon as possible.
* The Whiteboard tag "[backout-needed]" is added to the bug.
* The [https://wiki.mozilla.org/Modules/FirefoxOS module owner] is also needinfo?ed.
* A Smoke Test report email is sent daily by the Firefox OS QA team to the following mailing lists: fxosqa-report-watchlist@mozilla.org and b2g-release-drivers@mozilla.org
* QA tracks the bug until the commit has been backed out.
* QA requests for a new nightly build to be created.
* When a new build becomes available, QA verifies that the bug no longer reproduces.
= Test Automation =
* Gaia UI Tests: https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests
Confirmed users
330

edits