Latest revision as of 09:55, 27 June 2013

Platform Apps Testing

Author: David Clarke

Date: 05/30/2013

Overview

Apps Based Testing Gaps

Automation

The immediate goal of this project was to identify areas of testing for Apps that have been missed by current automation methods. The overview was completed as of 05/30/2013. The review process generally involved Jason Smith & Fabrice & Julien reviewing the strategy and evaluating these areas as being in need of being tested at the end of this effort.

Below are the areas identified for testing / developing coverage.

Packaged Apps

[P1] Install/launch/uninstall signed/unsigned packaged app
[P1] Install failure for packaged app not signed with type privileged (Security)
[P1] Install failure for packaged app with type certified (Security)
[P1] Cancel download of packaged app
[P1] Restart download of packaged app
[P>1] Download failure for packaged app for having a bad packaged app zip

Updated Apps

[P1] Updated Manifest
[P1] Updated Manifest with preloaded appcache
[P1] General pieces of download portions of API on install/update
[P1] Web activities app install/update

Preloaded Appcache

[P1] Install/launch/uninstall hosted app with appcache
[P>1] Download failure for hosted app with appcache for running out of space
[P1] Restart download of hosted app with appcache

Hosted Apps

[P1] Install/launch/uninstall hosted app
[P1] Install failure for hosted app with type as privileged or certified
[P1] Cancel download of hosted app with appcache
[P>1] Download failure for hosted app with appcache for having a bad appcache manifest

Bugs

bug 880043 Core DOM: App Mochitest: Install / Launch / Uninstall signed packaged app
bug 880046 Core DOM: App Install failure for unsigned privileged / signed certified packaged apps fail
bug 880053 Core DOM: App Tests to exercise update app Apps Object api.
bug 880069 Core DOM: App Changes to manifest trigger an update
bug 880074 Core DOM: App Mochitest: Install of hosted app with appcache
bug 880076 Core DOM: App Mochitest: Download failure for hosted app

@@ Line 1: / Line 1: @@
-= Test Plan OpenWebApps  =
+= Platform Apps Testing  =
 Author: David Clarke
-Date: 08/17/2011<br>
+Date: 05/30/2013
-== Desktop  ==
+== Overview  ==
-=== Windows - P1  ===
+'''Apps Based Testing Gaps'''
-==== Use Cases  ====
+== Automation ==
+The immediate goal of this project was to identify areas of testing for Apps that have been missed by current automation methods.
+The overview was completed as of 05/30/2013. The review process generally involved Jason Smith & Fabrice & Julien reviewing the strategy and evaluating these areas as being in need of being tested at the end of this effort.
-{{Generic_TestCases_WebApp
+Below are the areas identified for testing / developing coverage.
-|os=Windows
-|device=PC
-|browser = Firefox
-}}
-{{Generic_TestCases_WebApp
+=== Packaged Apps ===
-|os=Windows
+* [P1] Install/launch/uninstall signed/unsigned packaged app
-|device=PC
+* [P1] Install failure for packaged app not signed with type privileged  (Security)
-|browser = Chrome
+* [P1] Install failure for packaged app with type certified (Security)
-}}
+* [P1] Cancel download of packaged app
+* [P1] Restart download of packaged app
+* [P>1] Download failure for packaged app for having a bad packaged app zip
-{{Generic_TestCases_WebApp
+=== Updated Apps ===
-|os=Windows
+* [P1] Updated Manifest
-|device=PC
+* [P1] Updated Manifest with preloaded appcache
-|browser = IE 8/9
+* [P1] General pieces of download portions of API on install/update
-}}
+* [P1] Web activities app install/update
-==== Desktop App<br>  ====
+=== Preloaded Appcache ===
+* [P1] Install/launch/uninstall hosted app with appcache
+* [P>1] Download failure for hosted app with appcache for running out of space
+* [P1] Restart download of hosted app with appcache
-{| width="1109" cellspacing="1" cellpadding="1" border="1" style="" class="wikitable"
+=== Hosted Apps ===
-|-
+* [P1] Install/launch/uninstall hosted app
-| width="100" | '''Device<br>'''
+* [P1] Install failure for hosted app with type as privileged or certified
-| width="100" | '''PC'''<br>
+* [P1] Cancel download of hosted app with appcache
-| width="100" | '''Operating System<br>'''
+* [P>1] Download failure for hosted app with appcache for having a bad appcache manifest
-| width="100" | '''OSX'''<br>
-| width="100" | '''Browser'''
-| width="100" | '''Firefox'''
-|-
-| width="200" | Test Case<br>
-| width="200" | Steps<br>
-| width="300" colspan="4" | Expected Result <br>
-|-
-| Run app from desktop, non-paid<br>
-| Install a non paid app to the desktop run the app from desktop<br>
-| colspan="4" | application should run as expected
-|-
-| Run app from desktop, paid<br>
-| Install a paid app to the desktop
-run the app from the desktop<br>
-| colspan="4" | application should run as expected<br>
+== Bugs ==
-|-
+*{{Bug|880043}} 	Core 	DOM: App 	Mochitest: Install / Launch / Uninstall signed packaged app
-| App refunded, launch from Desktop <br>
+*{{Bug|880046}} 	Core 	DOM: App 	Install failure for unsigned privileged / signed certified packaged apps fail
-| Install a paid app to the desktop
+*{{Bug|880053}} 	Core 	DOM: App 	Tests to exercise update app Apps Object api.
-Issue a refund<br> run the paid app from the desktop<br>
+*{{Bug|880069}} 	Core 	DOM: App 	Changes to manifest trigger an update
+*{{Bug|880074}} 	Core 	DOM: App 	Mochitest: Install of hosted app with appcache
-| colspan="4" | application should not run, possibly forward to the store<br>
+*{{Bug|880076}} 	Core 	DOM: App 	Mochitest: Download failure for hosted app
-|-
-| Verify installation of apps work across multiple versions of windows<br>
-| Try to install the app on different versions of windows. <br>
-| colspan="4" | Verify install / launch works as expected<br>
-|-
-| uninstall firefox, verify apps don't launch
-| Uninstall firefox, click on an installed app
-| colspan="4" | App should fail to launch&nbsp;?&nbsp;
-|}
-<br>
-=== Mac - P1  ===
-==== Use Cases  ====
-{{Generic_TestCases_WebApp
-|os=Mac
-|device=PC
-|browser = Firefox
-}}
-{{Generic_TestCases_WebApp
-|os=Mac
-|device=PC
-|browser = Safari
-}}
-<br> {{Generic_TestCases_WebApp
-|os=Mac
-|device=PC
-|browser = Chrome
-}}
-==== Desktop App<br>  ====
-{| width="1109" cellspacing="1" cellpadding="1" border="1" style="" class="wikitable"
-|-
-| width="100" | '''Device<br>'''
-| width="100" | '''PC'''<br>
-| width="100" | '''Operating System<br>'''
-| width="100" | '''OSX'''<br>
-| width="100" | '''Browser'''
-| width="100" | '''Firefox'''
-|-
-| width="200" | Test Case<br>
-| width="200" | Steps<br>
-| width="300" colspan="4" | Expected Result <br>
-|-
-| Run app from desktop, non-paid<br>
-| Install a non paid app to the desktop run the app from desktop<br>
-| colspan="4" | application should run as expected
-|-
-| Run app from desktop, paid<br>
-| Install a paid app to the desktop
-run the app from the desktop<br>
-| colspan="4" | application should run as expected<br>
-|-
-| App refunded, launch from Desktop <br>
-| Install a paid app to the desktop
-Issue a refund<br> run the paid app from the desktop<br>
-| colspan="4" | application should not run, possibly forward to the store<br>
-|-
-| Verify installation of apps work across multiple versions of windows<br>
-| Try to install the app on different versions of windows. <br>
-| colspan="4" | Verify install / launch works as expected<br>
-|-
-| uninstall firefox, verify apps don't launch
-| Uninstall firefox, click on an installed app
-| colspan="4" | App should fail to launch&nbsp;?&nbsp;
-|}
-=== Linux -P2  ===
-== Mobile  ==
-== Tablet  ==
-== Cross Device Testing ==

Dclarke