QA/Execution/Web Testing/Goals/2013/Q2

From MozillaWiki
Jump to: navigation, search

High-level goals

Taken from https://intranet.mozilla.org/QA/Q22013_QAgoals

  • Goal: [CARRY OVER] Help support, through automated smoketests, the purchase, installation of, and refund of, apps in the Firefox Marketplace, on Firefox OS
  • Goal: [NEW] Build out and support additional infrastructure and processes, to be able to:
    • run Gaia UI Tests against v1-train and v1.0.1 (and v1.1?) concurrently
    • run the above on multiple devices (2 soon-to-ship ones)

Firefox Marketplace

  • Goal: [CARRY OVER] Help support, where possible through automated smoketests, the purchase, installation, and refund of, apps in the Firefox Marketplace, on Firefox OS
    • Dependencies:
      • Marionette's ability to reliably automate the purchase/refund flow(s), end-to-end
      • Persona login/logout/account management (in)
      • Infrastructure necessary for testing (live?) payments multiple times per day
    • Risks:
      • Any of the blocking Marionette bugs listed in bug 801898 - Get GaiaTest UI smoke tests running reliably in Jenkins CI, which could affect our ability to automate
      • feature readiness/stability on the Marketplace-app side
      • stability on the vendor/payment-provider side
      • lack of a "back-door," automation-friendly way to purchase, frequently
      • Marionette's (Firefox OS) ability to automate, end-to-end
    • Tracking Bugs:

Firefox OS

  • Goal: [NEW] Build out and support additional infrastructure and processes, to be able to:
    • run Gaia UI Tests against v1-train and v1.0.1 (and v1.1?) concurrently
    • run the above on multiple devices (Leo, Inari and/or Hamachi) - one device per branch
      • Dependencies:
        • Commercial RILs for/in Unagi/other engineering builds
      • Risks:
        • Lack of commercial RIL or even engineering build for any/all of the above
      • Tracking bugs:
        • .