Confirmed users
746
edits
Marketplace/Testing: Difference between revisions
updated for end of Q1
(added category) |
(updated for end of Q1) |
||
| Line 3: | Line 3: | ||
This is an overview of testing improvements for the Marketplace apps itself (zamboni, fireplace etc). | This is an overview of testing improvements for the Marketplace apps itself (zamboni, fireplace etc). | ||
=== Q1 Goals === | === Q1 Goals (completed) === | ||
* Improve testing of marketplace front end components (eg. marketplace-core-modules, marketplace-elements) | * Improve testing of marketplace front end components (eg. marketplace-core-modules, marketplace-elements) | ||
| Line 14: | Line 14: | ||
=== Later goals === | === Later goals === | ||
Things that might be a good idea. | Things that might be a good idea: | ||
==== Visual regression testing ==== | |||
* Attach images with large changes to PRs. | |||
==== Spin up a docker instance with changes for a PR ==== | |||
* When you submit a PR, spin up an AWS and load marketplace-env at your SHA. | |||
** This will aid manual testing (label:keep-test-env). | |||
** This will allow the integration tests to run against your PR. | |||
** Should this be app-specific? What if zamboni updates while your PR is open? | |||
* Video/screenshot of failing UI tests on Travis | |||
==== Testing visualization/metrics ==== | ==== Testing visualization/metrics ==== | ||
| Line 27: | Line 37: | ||
** This exists @ https://github.com/mozilla/marketplace-tests-gaia/tree/master/marketplacetests/payment | ** This exists @ https://github.com/mozilla/marketplace-tests-gaia/tree/master/marketplacetests/payment | ||
* Likely casperjs but there is already a python repo from QA. | * Likely casperjs but there is already a python repo from QA. | ||
=== Bugs === | === Bugs === | ||
| Line 46: | Line 45: | ||
{ "blocks": ["1127432"], "status": ["UNCONFIRMED", "ASSIGNED", "NEW", "REOPENED"] } | { "blocks": ["1127432"], "status": ["UNCONFIRMED", "ASSIGNED", "NEW", "REOPENED"] } | ||
</bugzilla> | </bugzilla> | ||