User:Dclarke

Test Plan OpenWebApps

Author: David Clarke

Date: 08/17/2011

Overview

Open Webapps is a fairly overloaded term, but basically incorporates a few main pieces of infrastructure.

• An App Store (based off of AMO)
  • Paypal Chained API for payments
• A set of Web API's that can be loosely defined as our App Cloud
• A browserID integration

The devices that will interact with the system are initially to be

• Desktop (Windows / Mac)
• Mobile (Android /iOS)
• Tablet (Android /iOS)

The purpose of this system is to serve as a way for HTML5 based apps to be distributed, across multiple devices.

Community Involvement

I see community involvement being a good way to do exploratory testing, gather usability feedback, as well as determine ease of use of the store / apps / widgets ..etc. The ability to test installs / usage patterns across multiple operating systems / tablets / phones will be very helpful.

Desktop

Windows - P1

Browsers w/o Addon

Device	PC	Operating System	Windows	Browser	Firefox / Chrome / IE 8&9
Test Case	Steps	Expected Result
Navigate the store and install an app, store in the app tab	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4) Install the Test app in the app tab	App should be installed in the dashboard
Navigate the store and install an app that is already installed	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4)Attempt to install the Test app in the app tab	Notification that the app is already installed
Navigate the store and install an app, when not logged in	1) Go to the OWA Store 2) Navigate to a Test App 3) Attempt to install the Test app in the app tab	Notification that not logged in
Attempt to run an app with no payment receipt	1) Go to your devices local storage 2) Delete the receipt for Test App 3) Attempt to run Test App	Test App should display a notification, that you should be redirected to the store to re-verify
Attempt to run an app with browserID down	Turn off browserID (server) Attempt to run an app	Appropriate error message should be displayed
App deletion	Delete the app from the dashboard	App should be deleted, and traces removed from local storage
App deletion / reinstall	1) Delete the app from the dashboard 2) Go to the OW A store 3) Login via Browser ID 4) Attempt to install the Test app in the app tab.	App should be deleted, should be able to install the app with no prompt for payment.
App deletion, attempt to run from another browser	1) Delete the app from the dashboard 2) Switch Browsers 3) Login via Browser ID 4) Attempt to run app	App should not be in the dashboard

Firefox w/Addon

Device	PC	Operating System	Windows	Browser	Firefox
Test Case	Steps	Expected Result
Navigate the store and install an app, store in the app tab	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4) Install the Test app in the app tab	App should be installed in the dashboard
Navigate the store and install an app that is already installed	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4)Attempt to install the Test app in the app tab	Notification that the app is already installed
Navigate the store and install an app, when not logged in	1) Go to the OWA Store 2) Navigate to a Test App 3) Attempt to install the Test app in the app tab	Notification that not logged in
Attempt to run an app with no payment receipt	1) Go to your devices local storage 2) Delete the receipt for Test App 3) Attempt to run Test App	Test App should display a notification, that you should be redirected to the store to re-verify
Attempt to run an app with browserID down	Turn off browserID (server) Attempt to run an app	Appropriate error message should be displayed
App deletion	Delete the app from the dashboard	App should be deleted, and traces removed from local storage
App deletion / reinstall	1) Delete the app from the dashboard 2) Go to the OW A store 3) Login via Browser ID 4) Attempt to install the Test app in the app tab.	App should be deleted, should be able to install the app with no prompt for payment.
App deletion, attempt to run from another browser	1) Delete the app from the dashboard 2) Switch Browsers 3) Login via Browser ID 4) Attempt to run app	App should not be in the dashboard

Device	PC	Operating System	OSX	Browser	Firefox
Test Case	Steps	Expected Result
Run app from desktop, non-paid	Install a non paid app to the desktop run the app from desktop	application should run as expected
Run app from desktop, paid	Install a paid app to the desktop run the app from the desktop	application should run as expected
App refunded, launch from Desktop	Install a paid app to the desktop Issue a refund run the paid app from the desktop	application should not run, possibly forward to the store
Verify installation of apps work across multiple versions of windows	Try to install the app on different versions of windows.	Verify install / launch works as expected
uninstall firefox, verify apps don't launch	Uninstall firefox, click on an installed app	App should fail to launch ?

Mac - P1

Use Cases

Device	PC	Operating System	Mac	Browser	Firefox
Test Case	Steps	Expected Result
Navigate the store and install an app, store in the app tab	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4) Install the Test app in the app tab	App should be installed in the dashboard
Navigate the store and install an app that is already installed	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4)Attempt to install the Test app in the app tab	Notification that the app is already installed
Navigate the store and install an app, when not logged in	1) Go to the OWA Store 2) Navigate to a Test App 3) Attempt to install the Test app in the app tab	Notification that not logged in
Attempt to run an app with no payment receipt	1) Go to your devices local storage 2) Delete the receipt for Test App 3) Attempt to run Test App	Test App should display a notification, that you should be redirected to the store to re-verify
Attempt to run an app with browserID down	Turn off browserID (server) Attempt to run an app	Appropriate error message should be displayed
App deletion	Delete the app from the dashboard	App should be deleted, and traces removed from local storage
App deletion / reinstall	1) Delete the app from the dashboard 2) Go to the OW A store 3) Login via Browser ID 4) Attempt to install the Test app in the app tab.	App should be deleted, should be able to install the app with no prompt for payment.
App deletion, attempt to run from another browser	1) Delete the app from the dashboard 2) Switch Browsers 3) Login via Browser ID 4) Attempt to run app	App should not be in the dashboard

Device	PC	Operating System	Mac	Browser	Safari
Test Case	Steps	Expected Result
Navigate the store and install an app, store in the app tab	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4) Install the Test app in the app tab	App should be installed in the dashboard
Navigate the store and install an app that is already installed	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4)Attempt to install the Test app in the app tab	Notification that the app is already installed
Navigate the store and install an app, when not logged in	1) Go to the OWA Store 2) Navigate to a Test App 3) Attempt to install the Test app in the app tab	Notification that not logged in
Attempt to run an app with no payment receipt	1) Go to your devices local storage 2) Delete the receipt for Test App 3) Attempt to run Test App	Test App should display a notification, that you should be redirected to the store to re-verify
Attempt to run an app with browserID down	Turn off browserID (server) Attempt to run an app	Appropriate error message should be displayed
App deletion	Delete the app from the dashboard	App should be deleted, and traces removed from local storage
App deletion / reinstall	1) Delete the app from the dashboard 2) Go to the OW A store 3) Login via Browser ID 4) Attempt to install the Test app in the app tab.	App should be deleted, should be able to install the app with no prompt for payment.
App deletion, attempt to run from another browser	1) Delete the app from the dashboard 2) Switch Browsers 3) Login via Browser ID 4) Attempt to run app	App should not be in the dashboard

Device	PC	Operating System	Mac	Browser	Chrome
Test Case	Steps	Expected Result
Navigate the store and install an app, store in the app tab	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4) Install the Test app in the app tab	App should be installed in the dashboard
Navigate the store and install an app that is already installed	1) Go to the OWA Store 2) Login via browserID 3) Navigate to a Test App 4)Attempt to install the Test app in the app tab	Notification that the app is already installed
Navigate the store and install an app, when not logged in	1) Go to the OWA Store 2) Navigate to a Test App 3) Attempt to install the Test app in the app tab	Notification that not logged in
Attempt to run an app with no payment receipt	1) Go to your devices local storage 2) Delete the receipt for Test App 3) Attempt to run Test App	Test App should display a notification, that you should be redirected to the store to re-verify
Attempt to run an app with browserID down	Turn off browserID (server) Attempt to run an app	Appropriate error message should be displayed
App deletion	Delete the app from the dashboard	App should be deleted, and traces removed from local storage
App deletion / reinstall	1) Delete the app from the dashboard 2) Go to the OW A store 3) Login via Browser ID 4) Attempt to install the Test app in the app tab.	App should be deleted, should be able to install the app with no prompt for payment.
App deletion, attempt to run from another browser	1) Delete the app from the dashboard 2) Switch Browsers 3) Login via Browser ID 4) Attempt to run app	App should not be in the dashboard

Desktop App

Device	PC	Operating System	OSX	Browser	Firefox
Test Case	Steps	Expected Result
Run app from desktop, non-paid	Install a non paid app to the desktop run the app from desktop	application should run as expected
Run app from desktop, paid	Install a paid app to the desktop run the app from the desktop	application should run as expected
App refunded, launch from Desktop	Install a paid app to the desktop Issue a refund run the paid app from the desktop	application should not run, possibly forward to the store
Verify installation of apps work across multiple versions of osx (*community*)	Try to install the app on different versions of osx.	Verify install / launch works as expected
uninstall firefox, verify apps don't launch	Uninstall firefox, click on an installed app	App should fail to launch ?

Mobile

Mobile importance is to get testing across different devices. Use cases will revolve around install, buying items from store, on fennec making sure the app dashboard loads, is responsive and updates / syncs with the rest of the user device cloud.

Notes:

Android versions / screen displays, multiple apps on fennec. Mobile browsers Safari / Android Browser Community would be very helpful here.

Automation

Marketplace: Verify payment flows / expectations from the store through the store in terms of log in / log out. Developer upload / configure app for store.