canmove, Confirmed users
7,108
edits
B2G/QA/Gaia Test Plan/Email Templates: Difference between revisions
B2G/QA/Gaia Test Plan/Email Templates (view source)
Revision as of 00:50, 2 November 2013
, 2 November 2013→Template Details
| (9 intermediate revisions by 2 users not shown) | |||
| Line 3: | Line 3: | ||
=== Template Details === | === Template Details === | ||
Use this email template to send out a daily report to | Use this email template to send out a daily report to the Mozilla testing team for the smoke test results. | ||
Subject: <Date> Smoke Test Result - <number passed>/<total tests ran> tests passed, <number of blocking issues> blockers | Subject: <Date> Smoke Test Result - <number passed>/<total tests ran> tests passed, <number of blocking issues> blockers, <number of partial fails> | ||
Hi Everyone, | Hi Everyone, | ||
| Line 11: | Line 11: | ||
<number passed> out of <total tests ran> tests passed for the <date> build. Here are the major issues that prevented the smoke tests from passing: | <number passed> out of <total tests ran> tests passed for the <date> build. Here are the major issues that prevented the smoke tests from passing: | ||
'''Bugs Breaking Smoke Tests''' | *Smoketest: <Link to Google spreadsheet or MozTrap run> | ||
Tests were performed with: (this can be found in the sources.xml file in the b2g directory) | |||
*Build ID <Insert Build ID here> | |||
*gecko: <Insert Gecko version here> | |||
*gaia: <Insert Gaia version here> | |||
*Base image <insert Base image here> | |||
*x reboots | |||
*x crashes (Indicate crash reports here, or existing bugs if already on file) | |||
'''New Bugs Breaking Smoke Tests''' | |||
* [NEW] <Summary of issue, hyperlink to github/bugzilla issue> | |||
'''Existing Bugs Breaking Smoke Tests''' | |||
* [EXISTING] <Summary of issue, hyperlink to github/bugzilla issue> | |||
* ... | * ... | ||
'''New | '''New Issues Not Breaking Smoke Tests''' | ||
* [NEW] <Summary of issue, hyperlink to github/bugzilla issue> - no assignee | * [NEW] <Summary of issue, hyperlink to github/bugzilla issue> - no assignee | ||
| Line 31: | Line 48: | ||
=== Example === | === Example === | ||
8/31/2012 Smoke Test Result - 10 | 8/31/2012 Smoke Test Result - 10/17 tests passed, 3 blockers | ||
Hi Everyone, | Hi Everyone, | ||
| Line 37: | Line 54: | ||
10 out of 17 passed for the 2012-08-31 build. Here are the major issues that prevented the smoke tests from passing: | 10 out of 17 passed for the 2012-08-31 build. Here are the major issues that prevented the smoke tests from passing: | ||
'''Bugs Breaking Smoke Tests''' | '''New Bugs Breaking Smoke Tests''' | ||
* [NEW] [https://github.com/mozilla-b2g/gaia/issues/4240 Launching multiple apps on the homescreen occasionally causes the phone to get stuck in a whitescreen of death] - no assignee | * [NEW] [https://github.com/mozilla-b2g/gaia/issues/4240 Launching multiple apps on the homescreen occasionally causes the phone to get stuck in a whitescreen of death] - no assignee | ||
* [NEW] [https://github.com/mozilla-b2g/gaia/issues/4239 Cannot usually login into marketplace - crashes upon launch, sometimes immediately during login] - no assignee | * [NEW] [https://github.com/mozilla-b2g/gaia/issues/4239 Cannot usually login into marketplace - crashes upon launch, sometimes immediately during login] - no assignee | ||
'''Existing Bugs Breaking Smoke Tests''' | |||
* [EXISTING] [https://github.com/mozilla-b2g/gaia/issues/3395 camera A dialog about "device-storage" appears when a photo is taken] - Dale Harvey | * [EXISTING] [https://github.com/mozilla-b2g/gaia/issues/3395 camera A dialog about "device-storage" appears when a photo is taken] - Dale Harvey | ||