QA/Execution/Web Testing/Goals/2013/Q2
From MozillaWiki
< QA | Execution | Web Testing
High-level goals
Taken from https://intranet.mozilla.org/QA/Q22013_QAgoals
- Goal: [CARRY OVER] Help support, through automated smoketests, the purchase, installation of, and refund of, apps in the Firefox Marketplace, on Firefox OS
- Goal: [NEW] Build out and support additional infrastructure and processes, to be able to:
- run Gaia UI Tests against v1-train and v1.0.1 (and v1.1?) concurrently
- run the above on multiple devices (2 soon-to-ship ones)
Firefox Marketplace
- Goal: [CARRY OVER] Help support, where possible through automated smoketests, the purchase, installation, and refund of, apps in the Firefox Marketplace, on Firefox OS
- Dependencies:
- Marionette's ability to reliably automate the purchase/refund flow(s), end-to-end
- Persona login/logout/account management (in)
- Infrastructure necessary for testing (live?) payments multiple times per day
- Testing can be done on marketplace-dev.allizom.org now, with the "testpay" system
- Risks:
- Any of the blocking Marionette bugs listed in bug 801898 - Get GaiaTest UI smoke tests running reliably in Jenkins CI, which could affect our ability to automate
- feature readiness/stability on the Marketplace-app side
- stability on the vendor/payment-provider side
- lack of a "back-door," automation-friendly way to purchase, frequently
- Marionette's (Firefox OS) ability to automate, end-to-end
- Tracking Bugs:
- Dependencies:
Firefox OS
- Goal: [NEW] Build out and support additional infrastructure and processes, to be able to:
- run Gaia UI Tests against v1-train and v1.0.1 (and v1.1?) concurrently
- run the above on multiple devices (Leo, Inari and/or Hamachi) - one device per branch
- Dependencies:
- Commercial RILs for/in Unagi/other engineering builds
- Risks:
- Lack of commercial RIL or even engineering build for any/all of the above
- Tracking bugs:
- .
- Dependencies: