B2G/QA/WebAPI Test Plan/Simple Push
From MozillaWiki
< B2G | QA | WebAPI Test Plan
Contents
Purpose
This document intends to provide a high level overview of the testing that's needed for testing of the Simple Push WebAPI on Firefox OS.
Testing Scope
In Scope
- Simple Push DOM API testing with reference push server on target release devices (e.g. leo)
- Sanity testing around Simple Push API integrating with a target push server for a Firefox OS release
Out of Scope
- Full extensive testing of any non-reference push server with the Simple Push DOM API
- Actual third-party Simple Push apps using the API
Testing Lifecycle
Overview
This section provides an overview of the lifecycle of testing of the Simple Push API on Firefox OS.
DOM API and Reference Push Server Testing
Summary
End to end testing of the Simple Push API against the reference push server.
Signoff Criteria
- Full test pass of planned test cases executed against target release device
- All blocker bugs fixed and verified
Reference App End to End Automation
Summary
Create a reference app that run through a bunch of Simple Push API tests on device in an automated manner and report pass/fail results. This app should be able to run any device Firefox OS is supported on.
Signoff Criteria
- Completion of development of a reference app that can through a suite of Simple Push tests in an automated manner
- All tests passing in the reference app on target release devices
DOM API Mochitests
Summary
Development of mochitests to cover basic Simple Push API scenarios on Firefox OS.
Signoff Criteria
Smoke tests for the Simple Push API have been built as mochitests and checked into mozilla central.
Infrastructure
- Mochitest development will require a local server to be built to run the mochitests against in buildbot
Test Case Management
- End to end test cases are defined here
- MozTrap test cases will be written for regression tests using the reference app automation
- Other test cases not covered in MozTrap will be maintained here and ran as needed
