Apps/QA/Dashboard

From MozillaWiki
< Apps‎ | QA
Jump to: navigation, search

Owners



QA Lead: Jason Smith, David Clarke
Lead Developer: TBD

Quick Start Guide

Here is a quick start guide to start testing the dashboard:

  1. Install apps - Sample apps can be found on the App Directory or Marketplace
  2. View the Dashboard - Apps can be found by clicking the 'Apps' button at the bottom right of your browser or by going here

Once you have apps installed, you can launch them by clicking on them in the Dashboard. You can re-arrange the app icons and you can delete them from the Dashboard as well.

Testing Initiative

Scope

  • App installation
  • Launching apps
  • Dashboard Management
  • Uninstalling apps
  • App Sync
  • App upgrading

Requirements and Development Processes

  1. Determine dashboard requirements and specifications
  2. Create manual test cases for basic sanity coverage
  3. Develop automated test cases for manual test cases
  4. Exploratory testing of the dashboard
  5. Creation of complex manual scenario testing

Note: Requirements are highly volatile, so manual and automated test cases need to be consistently kept up to date.

Bug Tracking and Reporting

Bugs are reported under the Web Apps product in the following components:

  • Dashboard: Issues related to the dashboard representation on myapps.mozillalabs.com
  • HTML: Issues regarding underlying HTML problems that affect the dashboard
  • General: Any other issues that do not belong in the other two components

Note: See How to Write a Proper Bug on how to report bugs.

Build Verification Process

  1. Request deployment of bug fixes to the staging environment through David Clarke or Ian Bicking
  2. Verify any bugs that have been resolved for dashboard-applicable bugs
  3. Run automation tests to make sure no regressions have occurred
  4. Run manual test cases and exploratory test to capture possible regressions
  5. File new bugs as necessary
  6. Update the test case document by adding and modifying existing test cases and removing obsolete test cases
  7. If the build is an acceptable state, request deployment of bug fixes to the production environment through Ian Bicking

Automation

The automation effort will focus on automating manual test cases using Selenium. Stay tuned for more information on the automation approach.

Apps Test Server

An already existing nodejs server was modified to host test apps that we can use for load and smoke testing. To use the test server, please follow these steps (in linux):

Setup:

  1. git clone git://github.com/mozilla/openwebapps.git
  2. cd openwebapps
  3. Type: 'git submodule init' and then 'git submodule update'
  4. Make sure to have node installed - If not, you can get it from here. You can also follow one of the methods here.

Run:

  1. cd site/tests/
  2. Type: 'node run.js' - All necessary servers will start
  3. Launch the URL after 'Testing server started, to run tests go to:' and replace index.html with appstore.html
  4. A webpage will be shown that contains all the test apps
Test Server Screenshot.png

How It Works:

It's just a nodejs server that creates a separate server for each app that we have and hosts the necessary files within each server. The directory where the apps are stored is in site/tests/apps and each app has a folder within this directory.If you would like to add apps, all you have to do is add a folder within the apps directory and place the necessary files within that folder (please look at repo under site/tests/apps/ for examples). Please note the following:

  • The manifest file must be called: manifest.webapp (this should be changed within the code to be more dynamic)
  • If there is a problem with the page formatting, it's most likely because the icon pic used for the app is not compatible. The icon pic must be 128x128px in order to show up properly in the test server and in the Dashboard. You can use software such as gimp to adjust the pic size.

Other Documents and Links

QA

Test Cases Document

March 1st Test Run

Apps Questions

Information and Tracking

Dashboard Spec Document

Old Apps Sync Spec

Apps In the Cloud Spec

Apps Wiki

Apps Overview - Main

WebRT

Apps Github Repository

Sample Apps