Loop/Test

From MozillaWiki
Jump to: navigation, search

Overview

Summary

The purpose of this wiki is to provide a reference for manually testing Hello Firefox (Loop) from both client & server side. This document is not intended to be exhaustive, but more a 'how-to' reference of test tools, stack check, end-2-end (e2e) testing, etc.


#toc

Notes

  • Everything documented here is in the process of being automated.
  • This content needs further consolidation, but placing existing wiki content here for now...
  • For test strategy, please refer instead to: Loop/QA


#toc


Testing Categories

Testing can be divided roughly into 4 categories:


#toc


Stack Check

Description

Stack check serves as a kind of 'kick-the-tires', server-side test to verify that a service is up-and-running, where we expect it to be, with the right configuration, URLs, etc. i.e. verifying everything we can short of doing a load or e2e test.

  1. verify that the correct release has been deployed
  2. verify that basic services are up-and-running


How-to ---> Loop/Test/Stack Check


#toc


End-2-End Testing

Description

End-2-end (ore: "e2e") tests serve as a kind of comprehensive, client-side 'smoke test' using a service-enabled product to verify proper basic function from the user's perspective. By performing the same actions a user would, you can also ensure that the client is correctly consuming all backend services.


End-2-end tests can also be used as a kind of sanity test for both STAGE and PRODUCTION service deployments. This kind of testing may require some configuration changes to 'point' the client application to either the STAGE or PRODUCTION service, but (in general), the test methodology would remain the same.


How-to --->


#toc


Loadtesting

Description

verify that service can handle adequate load/traffic

  1. verify that the service is robust (won't crash under load)
  2. verify that the service can scale (load-balancing, etc.)


How-to ---> Loop/Test/Loadtesting


#toc


Functional Testing

Description

  • verify functionality of all client-side features (not covered in this wiki)

Other Wikis

These may be out-of-date


#toc


Reference

Wikis


#toc


Docs


#toc


Github Repos


#toc


Bugzilla


#toc