Platform Apps Testing

Author: David Clarke

Date: 05/30/2013

Overview

Apps Based Testing Gaps

Automation

The immediate goal of this project was to identify areas of testing for Apps that have been missed by current automation methods. The overview was completed as of 05/30/2013. The review process generally involved Jason Smith & Fabrice & Julien reviewing the strategy and evaluating these areas as being in need of being tested at the end of this effort.

Below are the areas identified for testing / developing coverage.

Packaged Apps

• [P1] Install/launch/uninstall signed/unsigned packaged app
• [P1] Install failure for packaged app not signed with type privileged (Security)
• [P1] Install failure for packaged app with type certified (Security)
• [P1] Cancel download of packaged app
• [P1] Restart download of packaged app
• [P>1] Download failure for packaged app for having a bad packaged app zip

Updated Apps

• [P1] Updated Manifest
• [P1] Updated Manifest with preloaded appcache
• [P1] General pieces of download portions of API on install/update
• [P1] Web activities app install/update

Preloaded Appcache

• [P1] Install/launch/uninstall hosted app with appcache
• [P>1] Download failure for hosted app with appcache for running out of space
• [P1] Restart download of hosted app with appcache

Hosted Apps

• [P1] Install/launch/uninstall hosted app
• [P1] Install failure for hosted app with type as privileged or certified
• [P1] Cancel download of hosted app with appcache
• [P>1] Download failure for hosted app with appcache for having a bad appcache manifest

Bugs

• bug 880043 Core DOM: App Mochitest: Install / Launch / Uninstall signed packaged app
• bug 880046 Core DOM: App Install failure for unsigned privileged / signed certified packaged apps fail
• bug 880053 Core DOM: App Tests to exercise update app Apps Object api.
• bug 880069 Core DOM: App Changes to manifest trigger an update
• bug 880074 Core DOM: App Mochitest: Install of hosted app with appcache
• bug 880076 Core DOM: App Mochitest: Download failure for hosted app