FirefoxOS/DeviceQA/2015TestRoadmap

From MozillaWiki
Jump to: navigation, search

Members

  • OS support members
    • Eric, Edward, Shing, Hermes, Teri, Gerry, Alison
  • Device Branch members
    • Hubert, William, Mike
  • MCTS, ConnDevices members
    • Al, Askeing, Owen, Cynthia
  • Stability
    • Paul, Walter, Shako

2015 Short-term

OS Support

  • 2.2 release
    • Milestone criteria gatekeeper
    • Provide project health status
    • Balance resource load
    • Increase automation rate
    • Test case review meeting
    • Module ownership
    • Regular Performance report
      • work with EPM to come out the performance scenarios and criteria
  • 2.5
    • Gaia UI test in JavaScript or follow the automation members’ (Geo, Johan) plan
    • Prepare for 2.5

Device branch

  • 2.0M Woodduck
  • 2.1S Dolphin
  • 2.2 new devices branch
  • other devices support
  • Work with 3rd party test lab
  • Device release process
  • Health status

MCTS

  • 2.0, 2.1 release package support and maintenance
  • 2.2 new architecture design and package delivery
    • 2015/06 ship the first package
  • easy to install, execute and troubleshooting
  • web site must be up to date
  • work with partners to have the clear process and help on issues resolve
  • must include the non-mobile devices

MTBF

  • 2.2 support, nightly build test
  • think how to support master/M-C
  • more debug information
  • escalation earlier and work with developer
  • help partners to setup, execution and troubleshooting
  • test scenarios coverage and review
  • Sync information with partners (CAF)

ConnDevices

  • web api test support
  • non-mobile devices support
  • MCTS try run
  • Stingray test ownership

Others:

  • requests from other teams

2015 Mid-term

  • Automation
    • JavaScript Marionette
  • Performance test
    • test scenarios and criteria
    • working model, flow, resource
      • regular report, notification, issue replicate
    • Raptor
  • Battery consumption
    • Setup a lab in TPE
    • test scenarios and criteria
    • data for released devices
  • Emulator support (tbd)
  • MozTrap enhancement
  • FOTA service
  • Build Bisect tool
    • POC first

Long-term

  • TPE members can cover all b2g QA tests
  • Team structure
    • OS team
    • Device team
    • Cert team
    • Stability team
    • A-team
  • IOT, partners certification suite setup
    • equipments setup and lab construction
  • Technical knowledge, domain know how
    • b2g
    • mobile new technology
    • automation related
    • testing methodology